-- Logs begin at Sun 2022-08-07 10:14:18 UTC, end at Sun 2022-08-07 11:21:11 UTC. -- Aug 07 10:45:56.601525 dv-cinder-850320-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 10:45:56.610744 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 10:45:56 2022] *** Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: nodename: dv-cinder-850320-3-iscsi Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: machine: x86_64 Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: clock source: unix Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: pcre jit disabled Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: detected number of CPU cores: 4 Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: current working directory: / Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: detected binary path: /usr/bin/uwsgi-core Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: your processes number limit is 47680 Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: your memory page size is 4096 bytes Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: detected max file descriptor number: 2048 Aug 07 10:45:56.612768 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: lock engine: pthread robust mutexes Aug 07 10:45:56.614082 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: thunder lock: enabled Aug 07 10:45:56.614082 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 10:45:56.614082 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 10:45:56.653163 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: Python main interpreter initialized at 0x55bf166479c0 Aug 07 10:45:56.653163 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: python threads support enabled Aug 07 10:45:56.653163 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: your server socket listen backlog is limited to 100 connections Aug 07 10:45:56.653163 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: your mercy for graceful operations on workers is 90 seconds Aug 07 10:45:56.653494 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 10:45:56.653573 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: *** Operational MODE: preforking *** Aug 07 10:45:56.653817 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: *** uWSGI is running in multiple interpreter mode *** Aug 07 10:45:56.653817 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: spawned uWSGI master process (pid: 103132) Aug 07 10:45:56.653997 dv-cinder-850320-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 10:45:56.654544 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: spawned uWSGI worker 1 (pid: 103133, cores: 1) Aug 07 10:45:56.655497 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: spawned uWSGI worker 2 (pid: 103134, cores: 1) Aug 07 10:45:56.655497 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 10:45:57.311225 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 10:45:57.324681 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 10:45:58.389725 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:45:58.389725 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: from cryptography.utils import int_from_bytes Aug 07 10:45:58.390313 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:45:58.390313 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: from cryptography.utils import int_from_bytes Aug 07 10:45:58.407938 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:45:58.407938 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: from cryptography.utils import int_from_bytes Aug 07 10:45:58.408375 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:45:58.408375 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: from cryptography.utils import int_from_bytes Aug 07 10:46:00.848568 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 10:46:00.849139 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 10:46:00.849303 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 10:46:00.849665 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 10:46:00.849914 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 10:46:00.850298 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.850618 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.850951 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.851261 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.851584 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.851884 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.852194 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.852503 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.852720 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 10:46:00.853101 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.853192 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 10:46:00.853273 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.853351 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.853474 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 10:46:00.853656 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-3-iscsi {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.853833 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 10:46:00.853969 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.854088 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 10:46:00.854267 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.854471 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.854564 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.854792 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.854889 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.855148 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.855264 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.855462 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.855553 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.855779 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.855873 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.856083 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.856281 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.856385 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857415 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857509 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857509 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857653 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857653 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857771 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857841 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857915 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.857982 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-3-iscsi {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.858055 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.858162 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.858273 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.858465 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.858556 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.858771 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.858861 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.859113 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.859198 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.859418 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.859630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.859756 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.859869 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-3-iscsi {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.860045 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.860157 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.860400 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.860544 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.860711 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.860852 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.861112 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.861218 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.861414 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.861508 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.861714 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.861802 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.862024 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.862121 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.862337 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.862423 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.863227 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.863348 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.863549 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.863867 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.864018 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.864175 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.864264 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.864743 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.864833 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.865037 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.865173 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-3-iscsi {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.865338 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.865427 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.865638 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.865738 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.865949 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.866048 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.866247 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.866415 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.866542 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.866725 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.866812 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.867056 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.867151 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.867377 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.867466 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.867695 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.867780 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.867999 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.868093 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.868244 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.868330 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.868490 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.868640 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.868799 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.868958 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.869109 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.869274 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.869408 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.869573 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.869705 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.869878 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.870001 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.870182 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.870304 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.870496 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.870594 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.870803 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.870890 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.871133 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.871238 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.871384 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.871478 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.871688 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.871775 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872004 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872100 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872322 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872419 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872640 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872737 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872888 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.872987 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.873137 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.873317 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.873450 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.873546 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.873767 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.873856 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.874068 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.874163 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.874372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.874459 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.874672 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.874766 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.874995 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.875098 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.875300 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.875398 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.875600 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.875696 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.875899 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.875987 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.876199 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.876296 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.876506 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.876591 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.876812 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.876897 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.877113 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.877209 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.877356 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.877450 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.877649 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.877744 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.877945 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.878114 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.878280 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.878464 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.878578 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.878865 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.879124 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.879226 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.879363 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.879458 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.879683 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.879778 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.879991 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.880080 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.880310 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.880449 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.880604 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.880728 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.880900 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.880990 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.881195 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.881281 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.881491 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.881577 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.881786 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.881875 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.882081 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.882178 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.882390 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.882477 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.882636 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.882723 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.882944 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.883034 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.883264 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.883374 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.883572 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.883660 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.883867 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.883956 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.884167 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.884263 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.884461 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.884548 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.884754 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.884839 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.885056 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.885229 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.885350 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.885484 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.885645 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.885749 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.885944 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.886040 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.886238 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.886324 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.886534 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.886628 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.886835 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.886969 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.887147 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.887236 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.887442 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.887529 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.887747 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.887847 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.888042 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.888130 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.888336 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.888424 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.888632 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.888782 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.888922 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.889017 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.889215 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.889304 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.889509 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.889610 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.889801 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.889889 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.890099 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.890184 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.890386 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.890480 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.890695 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.890782 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.891017 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.891110 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.891320 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.891416 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.891617 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.891713 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.891912 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.892006 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.892219 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.892366 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.892513 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.892610 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.892815 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.892914 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.893126 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.893215 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.893426 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.893513 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.893745 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.893847 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.894101 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.894253 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.894412 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.894617 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.894711 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.894937 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.895067 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.895247 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.895334 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.895549 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.895645 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.895849 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.895938 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.896145 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.896232 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.896459 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.896547 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.896775 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.896871 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.897078 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.897165 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.897379 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.897483 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.897678 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.897772 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.897992 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:46:00.898128 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.898291 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.898395 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.898599 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.898688 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.898914 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.899039 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.899250 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.899346 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.899552 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.899648 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.899883 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.899985 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.900196 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.900295 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.900509 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.900596 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.900816 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.900903 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.901125 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.901228 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.901428 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.901527 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.901731 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.901820 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.902032 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.902129 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.902340 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.902426 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.902652 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.902747 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.902977 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.903082 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.903289 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.903378 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.903591 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.903680 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.903895 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.903984 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.904197 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.904292 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.904497 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.904597 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.904799 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.904892 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.905116 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.905211 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.905419 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.905506 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.905727 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.905816 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.906029 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.906124 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.906336 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.906499 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.906637 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.906732 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.906974 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.907079 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.907262 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.907362 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.907556 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.907644 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.907851 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.907942 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.908145 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.908242 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.908445 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.908534 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.908739 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.908827 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.909049 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.909148 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.909893 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.909992 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.910282 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.910478 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.910639 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.910897 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.911061 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.911245 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.911335 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.911560 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.911658 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.911896 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.911985 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.912202 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.912289 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.912509 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.912611 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.912813 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.912901 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.913112 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.913200 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.913424 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.913519 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.913725 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.913821 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.914023 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.914119 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.914323 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.914423 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.914620 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.914707 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.914916 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.915049 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.915244 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.915343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.915543 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.915637 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.915844 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.915933 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.916146 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.916246 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.916449 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.916537 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.916766 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.916854 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.917068 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.917156 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.917368 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.917463 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.917674 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.917760 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.917981 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.918070 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.918280 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.918373 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.918584 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.918679 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.918891 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.919059 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.919217 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.919304 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.919513 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.919609 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.919818 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.919906 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.920117 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.920204 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.920422 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.920518 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.920721 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.920807 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921020 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921105 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921316 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921451 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921613 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921702 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921910 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.921997 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.922206 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.922303 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.922502 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.922590 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.922815 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.922910 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.923142 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.923245 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.923438 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.923532 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.923733 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.923860 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.924028 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.924117 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.924357 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.924442 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.924651 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.924748 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.925039 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.925650 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.925933 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.926195 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.926287 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.926550 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.926640 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.926855 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.926966 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.927191 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.927277 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.927496 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.927583 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.927796 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.927882 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.928099 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.928185 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.928398 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.928494 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.928700 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.928796 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.929002 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.929090 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.929300 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.929396 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.929602 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.929698 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.929914 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.930014 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.930217 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.930311 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.930517 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.930605 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.930813 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.930908 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.931136 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.931232 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.931463 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.931549 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.931771 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.931870 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.932081 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.932176 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.932393 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.932481 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.932695 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.932792 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933002 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933090 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933303 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933398 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933605 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933693 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933903 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.933990 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.934204 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.934292 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.934506 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.934594 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.934804 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.934891 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.935136 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.935225 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.935438 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.935527 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.935749 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.935849 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.936048 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.936138 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.936355 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.936445 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.936650 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.936737 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.936954 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.937041 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.937252 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.937340 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.937563 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.937650 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.937866 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.937962 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.938168 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.938264 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.938478 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.938566 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.938778 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.938876 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.939102 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.939204 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.939407 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.939496 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.939702 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.939816 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.939997 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.940121 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.940298 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.940383 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.940622 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.940723 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.941115 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.941208 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.941508 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.941606 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.941805 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.941895 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.942113 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.942201 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.942414 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.942501 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.942710 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.942800 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.943031 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.943134 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.943337 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.943425 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.943650 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.943740 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.943951 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.944039 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.944262 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.944349 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.944571 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.944660 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.944865 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.944952 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.945158 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.945254 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.945470 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.945572 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.945770 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.945859 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.946063 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.946160 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.946356 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.946444 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.946647 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.946734 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.946982 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.947088 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.947295 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.947383 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.947588 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.947674 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.947895 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.947992 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.948196 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.948292 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.948494 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.948589 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.948795 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.948883 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.949093 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.949179 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.949388 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.949484 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.949695 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.949785 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.949997 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.950083 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.950301 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.950389 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.950602 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.950691 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.950902 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.951016 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.951225 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.951313 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.951525 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.951666 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.951835 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.951923 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.952134 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.952222 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.952429 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.952517 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.952725 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.952820 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.953019 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.953120 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.953316 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.953403 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.953625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.953715 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.953930 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.954179 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.954269 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.954503 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.954591 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.954808 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.954897 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.955143 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.955277 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.955449 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.955525 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.955754 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.955856 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.956070 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.956737 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.956929 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.957017 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.957301 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.957447 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.957649 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.957747 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.957955 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.958090 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.958252 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.958341 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.958548 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.958637 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.958850 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.958967 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.959172 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.959262 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.959469 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.959560 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.959763 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.959851 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.960064 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.960160 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.960359 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.960456 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.960661 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.960751 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.960956 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.961251 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.961346 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.961555 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.961643 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.961849 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.961936 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.962150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.962239 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.962441 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.962529 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.962752 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.962839 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.963074 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.963167 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.963371 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.963459 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.963666 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.963779 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.963961 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.964088 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.964292 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.964389 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.964590 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.964680 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.964920 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.965017 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.965237 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.965365 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.965568 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.965686 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.965867 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.965995 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.966163 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.966301 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.966476 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.966588 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.966770 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.966887 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.967093 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.967212 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.967388 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.967512 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.967690 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.967812 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.967990 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.968121 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.968284 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.968421 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.968586 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.968727 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.968884 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.969027 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.969187 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.969342 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.969489 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.969645 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.969782 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.969944 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.970081 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.970242 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.970376 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.970537 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.970686 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.970872 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.970994 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.971197 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.971288 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.971528 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.971618 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.971927 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.972070 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.972239 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.972526 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.972653 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.972821 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.972934 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.973115 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.973242 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.973424 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.973564 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.973720 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.973866 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.974015 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.974168 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.974310 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.974469 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.974611 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.974775 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.974909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.975108 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.975222 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.975407 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.975535 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.975713 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.975835 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.976013 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.976129 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.976318 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.976406 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.976624 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.976722 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.976921 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.977017 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.977224 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.977314 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.977526 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.977616 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.977837 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.977934 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.978140 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.978236 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.978433 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.978528 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.978727 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.978814 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.979042 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.979147 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.979338 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.979428 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.979630 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.979727 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.979929 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.980017 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.980221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.980311 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.980517 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.980619 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.980812 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.980907 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.981104 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.981191 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.981397 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.981486 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.981699 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.981794 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.981996 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.982092 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.982290 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.982376 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.982586 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.982711 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.982881 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.983042 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.983209 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.983300 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.983510 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.983613 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.983813 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.983902 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.984112 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.984210 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.984410 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.984500 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.984717 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.984805 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.985015 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.985102 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.985316 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.985409 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.985618 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.985717 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.985912 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.986011 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.986210 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.986298 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.986507 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.986602 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.986803 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.986891 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.987121 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.987211 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.987416 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.988057 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.988241 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.988377 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.988542 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.988858 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.989020 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.989176 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.989583 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.989754 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.989907 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.990040 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.990222 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.990349 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.990519 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.990651 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.990821 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.991047 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.991139 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.991353 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.991442 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.991694 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.991785 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.991995 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.992083 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.992304 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.992390 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.992607 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.992697 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.992910 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.993007 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.993211 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.993313 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.993512 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.993601 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.993808 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.993895 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.994107 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.994209 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.994404 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.994491 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.994696 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.994781 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.995030 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.995136 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.995332 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.995428 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.995627 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.995723 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.995922 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.996019 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.996214 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.996301 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.996513 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.996609 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.996806 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.996903 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.997119 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.997207 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.997435 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.997523 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.997757 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.997846 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.998054 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.998169 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.998358 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.998447 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.998659 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.998747 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.998987 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.999076 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.999294 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.999392 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.999586 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.999675 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:00.999888 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.000058 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.000195 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.000365 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.000500 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.000669 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.000803 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.000973 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.001106 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.001276 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.001406 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.001572 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.001710 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.001873 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.002013 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.002187 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.002310 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.002484 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.002627 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.002781 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.002957 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.003150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.004030 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.004128 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.004330 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.004482 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.004643 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.004792 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.005049 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.005137 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.005356 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.005453 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.005653 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.005786 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.006059 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.006147 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.006363 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.006461 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.006667 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.006757 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.006997 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.007087 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.007309 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.007396 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.007623 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.007721 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.007918 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.008005 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.008223 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.008318 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.008522 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.008641 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.008839 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.008948 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.009154 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.009251 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.009456 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.009544 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.009764 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.009853 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.010060 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.010163 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.010373 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.010461 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.010685 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.010773 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.011017 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.011121 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.011318 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.011405 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.011618 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.011731 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.011936 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.012035 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.012237 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.012336 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.012554 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.012642 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.012935 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.013022 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.013233 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.013323 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.013530 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.013618 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.013830 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.013928 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.014128 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.014217 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.014423 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.014512 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.014736 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.014832 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.015055 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.015158 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.015359 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.015456 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.015660 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.015748 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.015961 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.016054 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.016257 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.016352 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.016552 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.016650 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.016864 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.016952 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.017157 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.017246 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.017469 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.017566 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.017773 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.017869 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.018085 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.018174 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.018400 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.018498 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.018715 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.018813 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.019072 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.019258 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.019360 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.019658 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.019830 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.019951 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.020158 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.020247 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.020467 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.020557 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.020787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.020875 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.021110 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.021198 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.021413 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.021582 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.021714 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.021803 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.022020 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.022109 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.022322 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.022413 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.022622 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.022709 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.022953 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.023043 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.023261 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.023353 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.023568 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.023656 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.023871 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.023967 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.024152 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.024240 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.024449 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.024535 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.024740 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.024835 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.025033 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.025121 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.025325 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.025413 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.025624 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.025722 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.025916 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.026003 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.026209 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.026296 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.026503 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.026600 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.026814 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.026973 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.027131 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.027222 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.027442 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.027532 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.027741 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.027829 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.028036 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.028122 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.028327 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.028417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.028620 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.028709 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.028948 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.029034 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.029243 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.029332 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.029558 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.029654 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.029859 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.029947 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.030171 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.030259 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.030477 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.030571 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.030784 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.030887 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.031114 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.031205 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.031423 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.031510 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.031725 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.031825 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.032027 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.032118 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.032322 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.032411 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.032620 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.032715 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.032916 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.033002 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.033212 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.033301 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.033508 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.033610 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.033810 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.034014 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.034103 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.034346 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.034622 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.034788 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.034963 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.035056 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.035263 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.035374 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.035563 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.035682 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.035879 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.035990 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.036183 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.036295 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.036483 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.036583 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.036781 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.036871 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.037077 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.037165 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.037411 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.037502 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.037709 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.037797 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.038027 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.038129 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.038334 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.038424 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.038653 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.038741 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.038985 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.039092 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.039298 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.039387 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.039602 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.039689 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.039908 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.040003 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.040214 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.040304 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.040520 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.040608 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.040824 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.040912 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.041126 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.041213 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.041430 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.041515 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.041731 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.041820 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.042032 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.042126 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.042335 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.042542 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.042640 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.042868 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.042971 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.043217 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.043306 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.043527 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.043623 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.043833 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.043921 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.044139 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.044234 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.044447 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.044537 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.044750 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.044838 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.045050 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.045145 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.045354 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.045442 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.045655 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.045741 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.045971 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.046163 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.046286 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.046471 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.046604 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.046793 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.046963 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.047138 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.047273 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.047456 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.047585 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.047763 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.047896 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.048073 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.048205 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.048391 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.048559 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.048689 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.048867 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.048985 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.049167 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.049286 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.049477 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.049574 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.049786 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.049876 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.050692 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.050832 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.051014 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.051314 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.051415 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.051629 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.051718 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.051930 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.052031 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.052258 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.052452 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.052571 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.052787 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.052880 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.053093 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.053191 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.053408 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.053499 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.053724 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.053813 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.054032 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.054131 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.054332 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.054421 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.054646 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.054734 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.054972 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.055066 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.055264 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.055352 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.055571 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.055815 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.055913 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.056127 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.056216 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.056434 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.056521 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.056737 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.056840 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.057038 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.057126 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.057332 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.057420 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.057632 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.057729 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.057925 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.058015 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.058238 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.058326 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.058535 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.058626 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.058830 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.058944 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.059149 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.059237 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.059446 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.059534 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.059741 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.059827 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.060035 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.060124 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.060328 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.060418 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.060622 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.060709 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.060922 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.061012 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.061215 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.061444 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.061541 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.061784 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.061881 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.062086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.062175 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.062378 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.062466 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.062678 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.062805 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.062996 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.063090 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.063309 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.063398 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.063606 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.063696 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.063922 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.064020 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.064224 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.064313 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.064531 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.064618 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.064834 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.064922 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.065133 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.065222 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.065430 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.065527 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.066286 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.066421 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.066710 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.066861 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.067261 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.067360 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.067574 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.067663 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.067875 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.067964 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.068199 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.068295 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.068508 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.068595 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.068812 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.068907 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.069110 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.069206 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.069405 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.069493 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.069705 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.069800 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.070004 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.070095 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.070305 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.070394 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.070603 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.070692 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.070903 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.071024 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.071225 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.071313 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.071526 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.071613 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.071825 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.071913 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.072124 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.072211 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.072423 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.072518 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.072721 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.072816 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.073017 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.073112 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.073315 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.073411 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.073615 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.073704 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.073916 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.074004 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.074220 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.074318 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.074547 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.074637 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.074856 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.074966 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.075189 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.075295 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.075495 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.075582 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.075802 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.075896 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.076103 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.076192 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.076404 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.076651 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.076742 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.076982 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.077087 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.077285 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.077379 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.077604 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.077695 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.077907 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.078006 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.078205 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.078293 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.078511 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.078606 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.078814 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.078905 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.079167 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.079271 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.079475 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.079564 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.079782 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.079872 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.080086 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.080174 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.080394 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.080481 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.080692 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.080787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.080995 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.081083 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.081320 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.081422 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.081644 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.081888 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.081977 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.082221 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.082317 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.082530 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.082620 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.082838 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.082947 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.083168 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.083256 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.083465 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.083554 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.083767 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.083854 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.084073 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.084170 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.084371 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.084458 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.084666 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.084753 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.084958 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.085055 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.085258 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.085346 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.085552 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.085652 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.085845 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.085947 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.086137 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.086226 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.086430 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.086528 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.086729 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.086830 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087041 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087134 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087335 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087424 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087630 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087723 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087908 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.087997 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.088200 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.088375 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.088495 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.088684 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.088779 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.088996 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.089084 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.089312 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.089411 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.089616 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.089706 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.089912 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.089999 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.090203 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.090300 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.090519 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.090617 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.090830 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.090917 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.091160 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.091249 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.091473 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.091563 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.091780 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.091868 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.092091 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.092181 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.092392 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.092488 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.092702 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.092790 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093000 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093135 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093299 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093387 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093598 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093694 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093910 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.093996 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.094208 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.094296 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.094503 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.094598 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.094800 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.094891 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.095124 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.095212 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.095422 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.095520 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.095723 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.095810 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.096020 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.096106 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.096317 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.096416 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.096618 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.096754 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.096996 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.097202 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.097376 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.097510 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.097694 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.097783 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.097996 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.098093 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.098301 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.098400 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.098647 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.098744 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.098904 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.099019 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.099226 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.099316 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.099524 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.099621 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.099819 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.099918 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.100117 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.100213 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.100413 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.100512 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.100738 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.100836 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.101039 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.101126 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.101349 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.101437 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.101657 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.101755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.101962 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.102050 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.102279 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.102373 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.102582 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.102680 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.102897 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.103090 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.103235 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.103323 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.103547 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.103643 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.103854 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.103943 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.104179 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.104267 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.104485 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.104576 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.104787 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.104874 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.105092 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.105188 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.105385 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.105473 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.105621 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 10:46:01.105709 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.105982 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.106303 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.106624 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.106943 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.107269 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.107579 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.107895 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.108211 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.108516 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.108839 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.109145 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.109450 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.109754 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.110059 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.110363 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.110671 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.111006 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.111316 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.111629 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.111939 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.112259 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.113312 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.113838 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.114173 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.114756 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.115129 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.115443 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.115781 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.116110 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.116422 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.116732 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.117034 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:46:01.117274 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 10:46:01.261059 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Registered counter for database nova_api Aug 07 10:46:01.273990 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Registered counter for database nova_api Aug 07 10:46:01.282563 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.289141 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.294522 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.301739 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.345260 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.context [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf8b7f3-2643-43e0-8bb5-27854ec1f83d(cell1) {{(pid=103133) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 10:46:01.349220 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:46:01.349641 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:46:01.351233 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:46:01.351954 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:46:01.352389 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:46:01.354352 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:46:01.356325 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Registered counter for database nova_cell0 Aug 07 10:46:01.357687 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.context [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf8b7f3-2643-43e0-8bb5-27854ec1f83d(cell1) {{(pid=103134) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 10:46:01.361541 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:46:01.361674 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Registered counter for database nova_cell1 Aug 07 10:46:01.362009 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:46:01.365088 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:46:01.365826 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:46:01.366274 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:46:01.368315 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_concurrency.lockutils [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:46:01.370607 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.370735 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Registered counter for database nova_cell0 Aug 07 10:46:01.371348 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.375899 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Registered counter for database nova_cell1 Aug 07 10:46:01.377376 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.379520 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.383659 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.384935 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.392404 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.392818 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.523220 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Registered counter for database nova_cell0 Aug 07 10:46:01.531843 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.536526 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.540867 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO dbcounter [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Registered counter for database nova_cell0 Aug 07 10:46:01.550498 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG oslo_db.sqlalchemy.engines [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:46:01.555233 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writer thread running {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:46:01.872921 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:46:01.880279 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:46:01.880418 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:46:01.887595 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:46:02.220421 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:46:02.226382 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:46:02.231639 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf166479c0 pid: 103133 (default app) Aug 07 10:46:02.233678 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:46:02.234858 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Aug 07 10:46:02.235541 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Sun Aug 7 10:46:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:46:02.236683 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:46:02.243842 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: WARNING keystonemiddleware.auth_token [None req-01fc351b-395a-4258-ba94-36f5690039ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:46:02.249088 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf166479c0 pid: 103134 (default app) Aug 07 10:47:17.886218 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:17.887312 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 07 10:47:17.887691 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:17.900269 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:17.901404 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell1:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:17.902238 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell0:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:17.903341 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_cell0:SELECT=3 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:18.768942 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-be436f7f-0297-405d-a1f4-2da31dc796f5 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:18.800924 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-be436f7f-0297-405d-a1f4-2da31dc796f5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905703 Aug 07 10:47:18.801663 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Aug 7 10:47:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:21.083658 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:21.084650 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9f987cd1-8a11-4e68-9032-a56f31b91c71 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 07 10:47:21.085052 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:21.556286 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f8dead2d-3bd9-416a-bd78-cbc0873b0a6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:21.576066 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:47:21.576066 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Aug 07 10:47:21.604757 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-f8dead2d-3bd9-416a-bd78-cbc0873b0a6e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.509620 Aug 07 10:47:21.605778 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:47:21.619851 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:21.621057 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell1:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:21.622279 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell0:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:21.623094 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:21.827298 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-41f57375-968e-439b-96e2-cedbd5ff1edd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:21.831666 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:47:21.831666 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Aug 07 10:47:21.897400 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-41f57375-968e-439b-96e2-cedbd5ff1edd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282949 Aug 07 10:47:21.903242 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Aug 7 10:47:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:24.201092 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f8dead2d-3bd9-416a-bd78-cbc0873b0a6e admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:24.202108 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-f8dead2d-3bd9-416a-bd78-cbc0873b0a6e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 07 10:47:24.202504 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:24.857032 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-7e1225a2-a547-4598-a693-6e85edef71a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "id": "d1", "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:24.878749 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:47:24.878749 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Aug 07 10:47:24.900224 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-7e1225a2-a547-4598-a693-6e85edef71a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.690774 Aug 07 10:47:24.908095 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:47:24.913830 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-d20fbfe3-3a15-47cc-92bf-a463d523afbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:24.916670 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:47:24.916670 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: warnings.warn(msg) Aug 07 10:47:24.950229 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-d20fbfe3-3a15-47cc-92bf-a463d523afbd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040524 Aug 07 10:47:24.951090 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Aug 7 10:47:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:27.257005 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-7e1225a2-a547-4598-a693-6e85edef71a6 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:27.258618 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-7e1225a2-a547-4598-a693-6e85edef71a6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Aug 07 10:47:27.266971 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:27 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:27.675071 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-54ea6b98-aecd-4592-98a0-00e9f10c78a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "disk": 10}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:27.694438 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-54ea6b98-aecd-4592-98a0-00e9f10c78a7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429161 Aug 07 10:47:27.695048 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:47:27.707964 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-1a0766c0-3c90-4b4c-b034-3c4e539c2396 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:27.731728 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-1a0766c0-3c90-4b4c-b034-3c4e539c2396 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028131 Aug 07 10:47:27.732292 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Aug 7 10:47:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:29.951936 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-54ea6b98-aecd-4592-98a0-00e9f10c78a7 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:29.954106 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-54ea6b98-aecd-4592-98a0-00e9f10c78a7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002727 Aug 07 10:47:29.955018 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:30.387928 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-806e20f8-d22b-414f-87e2-436e547575b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:30.419964 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-806e20f8-d22b-414f-87e2-436e547575b8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458955 Aug 07 10:47:30.421010 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:47:30.434528 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2730e4da-bd86-4093-a015-4d1bbe00fbd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:30.467183 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-2730e4da-bd86-4093-a015-4d1bbe00fbd8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036128 Aug 07 10:47:30.468056 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Aug 7 10:47:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:32.691266 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-806e20f8-d22b-414f-87e2-436e547575b8 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:32.692255 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-806e20f8-d22b-414f-87e2-436e547575b8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 07 10:47:32.692640 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:33.124083 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6a7933eb-d2e0-4d65-b4d7-3741bfe81ced admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "vcpus": 4}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:33.144458 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-6a7933eb-d2e0-4d65-b4d7-3741bfe81ced admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445615 Aug 07 10:47:33.145303 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:47:33.157041 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-0ebd5276-6f14-426a-a166-8d62cf164685 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:33.186476 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-0ebd5276-6f14-426a-a166-8d62cf164685 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033122 Aug 07 10:47:33.187361 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Sun Aug 7 10:47:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:35.394032 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6a7933eb-d2e0-4d65-b4d7-3741bfe81ced admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:35.395081 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-6a7933eb-d2e0-4d65-b4d7-3741bfe81ced admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 07 10:47:35.395482 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:35.866191 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-3d717a71-ef0c-4ef1-a37d-b2fad1540f1b admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:35.891409 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-3d717a71-ef0c-4ef1-a37d-b2fad1540f1b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.489608 Aug 07 10:47:35.891960 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Aug 7 10:47:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:47:38.107783 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6a7933eb-d2e0-4d65-b4d7-3741bfe81ced admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:38.109473 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-6a7933eb-d2e0-4d65-b4d7-3741bfe81ced admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 07 10:47:38.110010 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:38.533577 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-277c4d81-76b6-4eaf-af38-69aad209b5ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:38.554770 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-277c4d81-76b6-4eaf-af38-69aad209b5ff admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.437764 Aug 07 10:47:38.555494 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 10:47:38.569190 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-f77318ca-f765-4743-a407-b5a5df1f5178 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:38.595993 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-f77318ca-f765-4743-a407-b5a5df1f5178 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030719 Aug 07 10:47:38.596574 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Aug 7 10:47:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:40.818740 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-277c4d81-76b6-4eaf-af38-69aad209b5ff admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:40.819829 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-277c4d81-76b6-4eaf-af38-69aad209b5ff admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 07 10:47:40.820232 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:41.222731 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2293af5f-01d0-4a3d-9ccb-454b3dbf0b5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:41.244096 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-2293af5f-01d0-4a3d-9ccb-454b3dbf0b5a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417984 Aug 07 10:47:41.244795 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:47:41.256652 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-b943e6ad-0c4b-43e0-a830-20b3b829b184 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:41.285944 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-b943e6ad-0c4b-43e0-a830-20b3b829b184 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032925 Aug 07 10:47:41.286832 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Aug 7 10:47:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:43.595144 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2293af5f-01d0-4a3d-9ccb-454b3dbf0b5a admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:43.596159 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-2293af5f-01d0-4a3d-9ccb-454b3dbf0b5a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 07 10:47:43.596554 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:47:44.004473 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-1bfc46f0-30c0-448b-a3f9-835174c71776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:44.023434 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-1bfc46f0-30c0-448b-a3f9-835174c71776 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.420521 Aug 07 10:47:44.023991 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 10:47:44.036660 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-0a2dd6bf-5268-428b-a731-9e7dbc6be10d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:44.061292 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-0a2dd6bf-5268-428b-a731-9e7dbc6be10d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028228 Aug 07 10:47:44.061869 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Aug 7 10:47:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:46.399319 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-1bfc46f0-30c0-448b-a3f9-835174c71776 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:46.400382 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-1bfc46f0-30c0-448b-a3f9-835174c71776 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 07 10:47:46.400826 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:46.844103 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-7681b8e0-68d1-4386-ad18-ef6d5d556c84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "disk": 80, "swap": 0, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:46.865416 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-7681b8e0-68d1-4386-ad18-ef6d5d556c84 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457194 Aug 07 10:47:46.866274 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 10:47:46.878342 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-d9238a27-57a0-4bef-a657-385cc087cc02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:46.903636 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-d9238a27-57a0-4bef-a657-385cc087cc02 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029127 Aug 07 10:47:46.904833 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Aug 7 10:47:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:47:49.131976 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-7681b8e0-68d1-4386-ad18-ef6d5d556c84 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:47:49.133387 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-7681b8e0-68d1-4386-ad18-ef6d5d556c84 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001870 Aug 07 10:47:49.133871 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:47:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:47:49.626561 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-4a61fc57-6de2-4e45-9897-f4b86ff6d2f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "vcpus": 8, "swap": 0}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:49.649878 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-4a61fc57-6de2-4e45-9897-f4b86ff6d2f1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.508873 Aug 07 10:47:49.650737 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Sun Aug 7 10:47:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 10:47:49.662970 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-be06415a-0cd6-4782-9f1c-175c8c7ac801 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:47:49.668289 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:49.696835 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-be06415a-0cd6-4782-9f1c-175c8c7ac801 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037763 Aug 07 10:47:49.698959 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Sun Aug 7 10:47:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:48:09.494052 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-4a61fc57-6de2-4e45-9897-f4b86ff6d2f1 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:09.495527 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-4a61fc57-6de2-4e45-9897-f4b86ff6d2f1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Aug 07 10:48:09.496015 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:48:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:09.506917 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:09.888477 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-53b99539-82e2-451d-8622-8c1c81c5b0b3 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:09.906674 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-53b99539-82e2-451d-8622-8c1c81c5b0b3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404217 Aug 07 10:48:09.907236 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Aug 7 10:48:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:48:10.972943 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-4a61fc57-6de2-4e45-9897-f4b86ff6d2f1 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:10.973942 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-4a61fc57-6de2-4e45-9897-f4b86ff6d2f1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 07 10:48:10.974330 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:11.609270 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6a2b921a-153f-4256-b54b-8b2b7c4157ea admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:11.615319 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-6a2b921a-153f-4256-b54b-8b2b7c4157ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6a2b921a-153f-4256-b54b-8b2b7c4157ea admin admin] Request method failure captured: Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Accept: application/json Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Connection: keep-alive Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Content-Length: 0 Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Host: 10.222.0.25 Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABi75hq2MMdG0zsonZ3J0fxU3WXbLY9DaEn8sYTjM1UkbrzSiEPI2eCJfINopdCdPrQ7_69Gudic4r8eyb1biEQTme20PJZEGcoki3nU5XYuxJthMFL1kWh4WkmDg9Bc8_pB4ezGHQfJvTuXNPm6tmzCffHqpMvPmm4ZdcYrXmMjGaH9qM Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Role: reader,admin,member Aug 07 10:48:11.618630 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Roles: reader,admin,member Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5ac47e3b09f43d19a23a0f457fe9e23", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant: admin Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User: admin Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Id: bac4e6b76fe64217ac8fa44e71cffe6a Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Name: admin Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: method: > Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: exception: Flavor 42 could not be found. Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: action_args: {'id': '42'} Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:48:11.620436 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:11.621343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.622787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-6a2b921a-153f-4256-b54b-8b2b7c4157ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:48:11.624393 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-6a2b921a-153f-4256-b54b-8b2b7c4157ea admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.503667 Aug 07 10:48:11.624393 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Aug 7 10:48:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:11.630380 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-45466c90-4598-45fd-9941-67edfcd0cb6f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:11.634589 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:11.656509 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-45466c90-4598-45fd-9941-67edfcd0cb6f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029588 Aug 07 10:48:11.657077 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Aug 7 10:48:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:48:11.667078 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-af793c9e-9db5-4c40-9c52-403ab338ae0e admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:11.692874 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-af793c9e-9db5-4c40-9c52-403ab338ae0e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029234 Aug 07 10:48:11.693341 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Aug 7 10:48:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:48:11.703827 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-ef94c15c-4701-4f31-ba60-0dab0be929f4 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:11.709982 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-ef94c15c-4701-4f31-ba60-0dab0be929f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-ef94c15c-4701-4f31-ba60-0dab0be929f4 admin admin] Request method failure captured: Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Accept: application/json Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Connection: keep-alive Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Content-Length: 0 Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Host: 10.222.0.25 Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi75hq2MMdG0zsonZ3J0fxU3WXbLY9DaEn8sYTjM1UkbrzSiEPI2eCJfINopdCdPrQ7_69Gudic4r8eyb1biEQTme20PJZEGcoki3nU5XYuxJthMFL1kWh4WkmDg9Bc8_pB4ezGHQfJvTuXNPm6tmzCffHqpMvPmm4ZdcYrXmMjGaH9qM Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Role: reader,admin,member Aug 07 10:48:11.713625 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Roles: reader,admin,member Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5ac47e3b09f43d19a23a0f457fe9e23", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant: admin Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User: admin Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Id: bac4e6b76fe64217ac8fa44e71cffe6a Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Name: admin Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: method: > Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: exception: Flavor 42 could not be found. Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: action_args: {'id': '42'} Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:48:11.715086 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:11.716425 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:11.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-ef94c15c-4701-4f31-ba60-0dab0be929f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:48:11.718461 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-ef94c15c-4701-4f31-ba60-0dab0be929f4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015486 Aug 07 10:48:11.718461 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Aug 7 10:48:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 07 10:48:12.693845 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-af793c9e-9db5-4c40-9c52-403ab338ae0e admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:12.694859 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-af793c9e-9db5-4c40-9c52-403ab338ae0e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 07 10:48:12.695274 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:13.218750 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f1363b74-a81e-4b2c-b854-5709dfa9b1b5 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:13.224316 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-f1363b74-a81e-4b2c-b854-5709dfa9b1b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f1363b74-a81e-4b2c-b854-5709dfa9b1b5 admin admin] Request method failure captured: Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Accept: application/json Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Connection: keep-alive Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Content-Length: 0 Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Host: 10.222.0.25 Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi75hsETh94vJbHC_ETzCOMq1syEqs3KbWltInAGqx2vtBn63-cXIiffjt9gMvJBb5w-FHCHrnqf6v8QgImMgTigGA8UrkRC78FqkhYZez50V6hVMH9xRUd8ZufXVSe60_vn9ApySML4usDE2OB7CCHgXRaT_vclj1n5d4ME23sZzt3pw Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Role: reader,admin,member Aug 07 10:48:13.225831 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Roles: reader,admin,member Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5ac47e3b09f43d19a23a0f457fe9e23", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant: admin Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User: admin Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Id: bac4e6b76fe64217ac8fa44e71cffe6a Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Name: admin Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: method: > Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: exception: Flavor 84 could not be found. Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: action_args: {'id': '84'} Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:48:13.227293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:13.228150 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.229479 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-f1363b74-a81e-4b2c-b854-5709dfa9b1b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:48:13.230707 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-f1363b74-a81e-4b2c-b854-5709dfa9b1b5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396770 Aug 07 10:48:13.230707 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Aug 7 10:48:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:13.237560 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a6d6bf80-2c08-4ac7-a4c7-d72db978efd7 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:13.253473 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a6d6bf80-2c08-4ac7-a4c7-d72db978efd7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019547 Aug 07 10:48:13.253983 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Aug 7 10:48:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:48:13.263340 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9474d1b3-012d-452d-8c78-b851fdce91df admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:13.277993 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9474d1b3-012d-452d-8c78-b851fdce91df admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018237 Aug 07 10:48:13.279085 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Aug 7 10:48:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:48:13.288114 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ce63f611-20c2-468e-8f58-e309e1f9faac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:13.293343 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-ce63f611-20c2-468e-8f58-e309e1f9faac admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ce63f611-20c2-468e-8f58-e309e1f9faac admin admin] Request method failure captured: Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Accept: application/json Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Connection: keep-alive Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Content-Length: 0 Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Host: 10.222.0.25 Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABi75hsETh94vJbHC_ETzCOMq1syEqs3KbWltInAGqx2vtBn63-cXIiffjt9gMvJBb5w-FHCHrnqf6v8QgImMgTigGA8UrkRC78FqkhYZez50V6hVMH9xRUd8ZufXVSe60_vn9ApySML4usDE2OB7CCHgXRaT_vclj1n5d4ME23sZzt3pw Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Role: reader,admin,member Aug 07 10:48:13.295883 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Roles: reader,admin,member Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5ac47e3b09f43d19a23a0f457fe9e23", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant: admin Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User: admin Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Id: bac4e6b76fe64217ac8fa44e71cffe6a Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Name: admin Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: method: > Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: exception: Flavor 84 could not be found. Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: action_args: {'id': '84'} Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:48:13.297431 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:13.298417 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:13.299755 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-ce63f611-20c2-468e-8f58-e309e1f9faac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:48:13.301138 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-ce63f611-20c2-468e-8f58-e309e1f9faac admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012644 Aug 07 10:48:13.301138 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Sun Aug 7 10:48:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 07 10:48:14.256275 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9474d1b3-012d-452d-8c78-b851fdce91df admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:14.257350 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9474d1b3-012d-452d-8c78-b851fdce91df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 07 10:48:14.257742 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:14.780198 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2beee595-25dd-4d9e-a185-ab57e64463e9 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:14.786118 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.wsgi [None req-2beee595-25dd-4d9e-a185-ab57e64463e9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2beee595-25dd-4d9e-a185-ab57e64463e9 admin admin] Request method failure captured: Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Accept: application/json Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Accept-Encoding: gzip, deflate Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Connection: keep-alive Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Content-Length: 0 Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Host: 10.222.0.25 Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Openstack-Api-Version: compute 2.90 Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Openstack-System-Scope: None Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: User-Agent: python-novaclient Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Auth-Token: gAAAAABi75hupcbflJmdoVkQoK18IHcBtYHfysRuQOGjvaIUIdGKhQZn2F7tD77vYK8hLkf6IlJkVo7z3_Wrvjs3MC2vrpOYOLESjGhwFG5Tut53axT2WcO3zT-lD2AhKhR8fu-SWg2dFjlm9XnQAvItcL1LPNSLPAkAgnBheLwr9f0lZUxdLMs Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Domain-Id: None Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Domain-Name: None Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Identity-Status: Confirmed Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Is-Admin-Project: True Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Domain-Id: default Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Domain-Name: Default Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Project-Name: admin Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Role: reader,admin,member Aug 07 10:48:14.787665 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Roles: reader,admin,member Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5ac47e3b09f43d19a23a0f457fe9e23", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant: admin Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-Tenant-Name: admin Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User: admin Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Domain-Id: default Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Domain-Name: Default Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Id: bac4e6b76fe64217ac8fa44e71cffe6a Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: X-User-Name: admin Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: method: > Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: exception: Flavor 451 could not be found. Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: action_args: {'id': '451'} Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:48:14.789372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:14.790361 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.791760 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-2beee595-25dd-4d9e-a185-ab57e64463e9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:48:14.793168 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-2beee595-25dd-4d9e-a185-ab57e64463e9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391102 Aug 07 10:48:14.793168 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Aug 7 10:48:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:14.799342 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-5cf9bb3b-9208-442c-8343-dd3623812404 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:14.814210 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-5cf9bb3b-9208-442c-8343-dd3623812404 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018369 Aug 07 10:48:14.814757 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Aug 7 10:48:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:48:14.823973 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-31609489-4387-411a-93f5-a9560278deac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:14.838943 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-31609489-4387-411a-93f5-a9560278deac admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018403 Aug 07 10:48:14.839460 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Sun Aug 7 10:48:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:48:14.849090 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-44b2ec07-77ed-421a-a07c-27da99758008 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:14.854377 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-44b2ec07-77ed-421a-a07c-27da99758008 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-44b2ec07-77ed-421a-a07c-27da99758008 admin admin] Request method failure captured: Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Accept: application/json Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Connection: keep-alive Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Content-Length: 0 Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Host: 10.222.0.25 Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi75hupcbflJmdoVkQoK18IHcBtYHfysRuQOGjvaIUIdGKhQZn2F7tD77vYK8hLkf6IlJkVo7z3_Wrvjs3MC2vrpOYOLESjGhwFG5Tut53axT2WcO3zT-lD2AhKhR8fu-SWg2dFjlm9XnQAvItcL1LPNSLPAkAgnBheLwr9f0lZUxdLMs Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Role: reader,admin,member Aug 07 10:48:14.855909 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Roles: reader,admin,member Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d5ac47e3b09f43d19a23a0f457fe9e23", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d5ac47e3b09f43d19a23a0f457fe9e23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant: admin Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant-Id: d5ac47e3b09f43d19a23a0f457fe9e23 Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User: admin Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Id: bac4e6b76fe64217ac8fa44e71cffe6a Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: X-User-Name: admin Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: method: > Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: exception: Flavor 451 could not be found. Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: action_args: {'id': '451'} Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:48:14.858221 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:14.859223 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Aug 07 10:48:14.860448 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-44b2ec07-77ed-421a-a07c-27da99758008 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:48:14.861674 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-44b2ec07-77ed-421a-a07c-27da99758008 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012341 Aug 07 10:48:14.861674 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Aug 7 10:48:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:15.823787 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-31609489-4387-411a-93f5-a9560278deac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:15.824826 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-31609489-4387-411a-93f5-a9560278deac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 07 10:48:15.825439 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:16.344971 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-2b8b7383-b3eb-41aa-a44e-abed1fbdf9de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:48:16.364546 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-2b8b7383-b3eb-41aa-a44e-abed1fbdf9de admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.399954 Aug 07 10:48:16.365075 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Aug 7 10:48:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:48:17.324141 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-31609489-4387-411a-93f5-a9560278deac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:17.325749 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-31609489-4387-411a-93f5-a9560278deac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 07 10:48:17.326150 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:17.847079 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-03fca7ed-2479-4869-a69a-a47058b90bc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:48:17.865958 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-03fca7ed-2479-4869-a69a-a47058b90bc8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402717 Aug 07 10:48:17.866500 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Aug 7 10:48:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:48:18.836177 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-31609489-4387-411a-93f5-a9560278deac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:18.837174 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-31609489-4387-411a-93f5-a9560278deac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 07 10:48:18.837562 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:19.354268 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-1a23f37a-d375-43c7-a472-7f9a6ddc2916 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:48:19.375884 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-1a23f37a-d375-43c7-a472-7f9a6ddc2916 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.399800 Aug 07 10:48:19.376563 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Aug 7 10:48:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:48:20.343358 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-31609489-4387-411a-93f5-a9560278deac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:20.344372 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-31609489-4387-411a-93f5-a9560278deac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 07 10:48:20.344811 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:20.874156 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-ebf4bbfe-b0f3-45a0-af45-4bae24c2b562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:48:20.893302 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-ebf4bbfe-b0f3-45a0-af45-4bae24c2b562 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407972 Aug 07 10:48:20.893833 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Sun Aug 7 10:48:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:48:21.853711 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-31609489-4387-411a-93f5-a9560278deac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:21.854706 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-31609489-4387-411a-93f5-a9560278deac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 07 10:48:21.855128 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:48:22.379489 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-05fc1475-7ef4-4007-8744-90db6486a3e0 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:48:22.400284 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-05fc1475-7ef4-4007-8744-90db6486a3e0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407165 Aug 07 10:48:22.400918 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Sun Aug 7 10:48:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:49:13.541196 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-31609489-4387-411a-93f5-a9560278deac admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:49:13.542296 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-31609489-4387-411a-93f5-a9560278deac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002277 Aug 07 10:49:13.542699 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Sun Aug 7 10:49:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:49:13.557293 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:13.965414 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-7f6677f6-ba5a-4087-8ff0-88d0cf0934c9 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:49:13.986219 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-7f6677f6-ba5a-4087-8ff0-88d0cf0934c9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.436803 Aug 07 10:49:13.987036 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Sun Aug 7 10:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:49:14.010292 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-e70facab-583c-422d-8dfa-b5d7e52d520a admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:49:14.013874 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG dbcounter [-] [103134] Writing DB stats nova_api:SELECT=14 {{(pid=103134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:14.019602 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-e70facab-583c-422d-8dfa-b5d7e52d520a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013049 Aug 07 10:49:14.020127 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Aug 7 10:49:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:49:14.032269 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-8193bdb8-298f-414f-bf96-6f2fa00cc6d0 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:49:14.039901 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-8193bdb8-298f-414f-bf96-6f2fa00cc6d0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011305 Aug 07 10:49:14.041023 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Aug 7 10:49:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:49:14.052323 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:49:14.060093 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011288 Aug 07 10:49:14.060737 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Sun Aug 7 10:49:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:49:14.071573 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-8d32df5c-9102-4fa5-87a3-07eac9497e83 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:49:14.078934 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-8d32df5c-9102-4fa5-87a3-07eac9497e83 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010879 Aug 07 10:49:14.079447 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Sun Aug 7 10:49:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:52:11.478125 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:11.479165 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 07 10:52:11.479555 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:52:11.619456 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=6 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:11.779329 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:11.782290 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:52:11.782290 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Aug 07 10:52:11.783446 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:11.783925 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:11.784351 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:11.785070 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:11.785511 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:11.785931 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:11.819588 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-0dee3591-d81e-4cde-a65a-a95d1f7b33c5 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201689 Aug 07 10:52:11.820141 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Aug 7 10:52:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:52:12.642612 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:12.643655 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 07 10:52:12.644040 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:52:12.831155 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:12.833511 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:52:12.833511 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Aug 07 10:52:12.834611 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:12.835121 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:12.835558 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:12.836270 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:12.836716 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:12.837132 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:12.857292 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-bac7d809-27e4-4ca2-9962-4eae6b9dbdd6 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077020 Aug 07 10:52:12.857849 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Aug 7 10:52:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 10:52:24.101278 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:24.102363 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 07 10:52:24.102836 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:52:24.249608 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell0:SELECT=4 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:24.250321 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell1:SELECT=4 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:24.250998 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=8 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:24.300305 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:24.302618 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:52:24.302618 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Aug 07 10:52:24.303805 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:24.304289 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:24.304711 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:24.305410 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:24.305844 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:24.306250 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:24.332018 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-e7ec5675-abfb-4003-8225-780da06cab5c admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086789 Aug 07 10:52:24.332493 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Aug 7 10:52:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:52:25.161217 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: DEBUG nova.api.openstack.wsgi [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] Calling method '>' {{(pid=103134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:25.162222 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: INFO nova.api.openstack.requestlog [None req-a730001e-f686-4241-a05e-b3340ec9b2e0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 07 10:52:25.162617 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: [pid: 103134|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Sun Aug 7 10:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:52:25.351518 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:52:25.353912 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:52:25.353912 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Aug 07 10:52:25.355021 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:25.355491 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:25.355938 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:25.356668 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:52:25.357103 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:52:25.357512 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:52:25.379685 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-eb66e63d-a79b-4f44-aca4-8a6cd300c4af admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079176 Aug 07 10:52:25.380219 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Sun Aug 7 10:52:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:53:22.345004 dv-cinder-850320-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 07 10:53:22.345528 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: Sun Aug 7 10:53:22 2022 - graceful shutdown triggered... Aug 07 10:53:22.345960 dv-cinder-850320-3-iscsi devstack@n-api.service[103133]: Gracefully killing worker 1 (pid: 103133)... Aug 07 10:53:22.346644 dv-cinder-850320-3-iscsi devstack@n-api.service[103134]: Gracefully killing worker 2 (pid: 103134)... Aug 07 10:53:23.346455 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: worker 1 buried after 1 seconds Aug 07 10:53:23.347011 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: worker 2 buried after 1 seconds Aug 07 10:53:23.347011 dv-cinder-850320-3-iscsi devstack@n-api.service[103132]: goodbye to uWSGI. Aug 07 10:53:23.348077 dv-cinder-850320-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 07 10:53:23.348786 dv-cinder-850320-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 07 10:53:23.351648 dv-cinder-850320-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 10:53:23.361167 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 10:53:23 2022] *** Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: nodename: dv-cinder-850320-3-iscsi Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: machine: x86_64 Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: clock source: unix Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: pcre jit disabled Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: detected number of CPU cores: 4 Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: current working directory: / Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: detected binary path: /usr/bin/uwsgi-core Aug 07 10:53:23.363228 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: your processes number limit is 47680 Aug 07 10:53:23.364461 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: your memory page size is 4096 bytes Aug 07 10:53:23.364461 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: detected max file descriptor number: 2048 Aug 07 10:53:23.364461 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: lock engine: pthread robust mutexes Aug 07 10:53:23.364461 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: thunder lock: enabled Aug 07 10:53:23.364461 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 10:53:23.364461 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 10:53:23.403927 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: Python main interpreter initialized at 0x5628bf71e9c0 Aug 07 10:53:23.403927 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: python threads support enabled Aug 07 10:53:23.403927 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: your server socket listen backlog is limited to 100 connections Aug 07 10:53:23.403927 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: your mercy for graceful operations on workers is 90 seconds Aug 07 10:53:23.404379 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 10:53:23.404379 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: *** Operational MODE: preforking *** Aug 07 10:53:23.404647 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: *** uWSGI is running in multiple interpreter mode *** Aug 07 10:53:23.404647 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: spawned uWSGI master process (pid: 117597) Aug 07 10:53:23.404860 dv-cinder-850320-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 10:53:23.405439 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: spawned uWSGI worker 1 (pid: 117615, cores: 1) Aug 07 10:53:23.405779 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: spawned uWSGI worker 2 (pid: 117616, cores: 1) Aug 07 10:53:23.407049 dv-cinder-850320-3-iscsi devstack@n-api.service[117597]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 10:53:24.068630 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 10:53:24.071760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 10:53:25.231344 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:53:25.231344 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: from cryptography.utils import int_from_bytes Aug 07 10:53:25.232065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:53:25.232065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: from cryptography.utils import int_from_bytes Aug 07 10:53:25.236030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:53:25.236030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: from cryptography.utils import int_from_bytes Aug 07 10:53:25.236460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:53:25.236460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: from cryptography.utils import int_from_bytes Aug 07 10:53:27.602474 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 10:53:27.603047 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 10:53:27.603324 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 10:53:27.603697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 10:53:27.603959 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 10:53:27.604356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.604689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.605017 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.605369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.605709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.606027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.606353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.606680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.607045 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.607314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.607637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.607969 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-3-iscsi {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.608297 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.608876 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.609191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.609517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.609829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.610157 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.610247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 10:53:27.610604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 10:53:27.610696 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.610961 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 10:53:27.611072 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.612343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 10:53:27.612563 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.612753 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 10:53:27.612944 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.616704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.617000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.617256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.617483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.617700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.617926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.618146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.618366 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.618574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.618794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.619008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.619263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.619481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.619687 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.619903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.620110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.620335 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.620540 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-3-iscsi {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.620757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.620983 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.621166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.621359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.621539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-3-iscsi {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.621686 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.621834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.622012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.622164 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.622335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.622487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.622668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.622851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.623015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.623185 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.623337 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.623489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.623641 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.623791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.623938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.624092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.624257 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.624407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.624557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.624706 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.624863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.625014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.625157 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.625307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.625462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.625611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.625760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.625917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.626059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.626207 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.626358 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.626507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.626668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.626820 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.627012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.627161 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.627302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.627302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.627579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-3-iscsi {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.627730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.627878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.628027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.628172 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.628323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.628496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.628647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.629317 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.629602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.629834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.629995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.630150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.630294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.630441 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.630590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.630747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.630889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.631085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.631240 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.631393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.631535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.631690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.631840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.631840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.632116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.632258 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.632407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.632559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.632708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.632708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.633000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.633149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.633301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.633453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.633596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.633737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.633878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.634019 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.634225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.634376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.634518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.634666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.634808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.635032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.635198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.635342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.635490 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.635638 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.635783 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.635783 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636071 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636512 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636978 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.636978 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.637261 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.637402 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.637543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.637696 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.638443 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.638598 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.638741 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.638894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.638894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.639237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.639393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.639535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.639684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.639836 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.639991 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.640134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.640285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.640427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.640569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.640716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.640867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.641118 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.641296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.641453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.641453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.641732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.641882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.642025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.642173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.642316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.642457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.642607 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.642759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.642902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.643070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.643234 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.643377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.643528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.643677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.643825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.643977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.644119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.644260 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.644420 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.645175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.645327 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.645470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.645629 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.645772 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.645932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.646084 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.646233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.646384 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.646533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.646675 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.646824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.647097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.647246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.647401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.647544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.647704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.647853 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.647995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.648150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.648299 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.648448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.648590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.648738 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.648878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.649032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.649032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.649317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.649459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.649618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.649760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.649918 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.650060 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.650208 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.650350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.650508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.650658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.650809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.650981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.651136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.651289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.651430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.651430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.651725 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.651875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.651875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.652158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.652306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.652461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.652603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.652745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.652887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.653038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.653188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.653345 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.653508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.653650 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.653811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.653961 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.654113 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.654261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.654419 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.654568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.654723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.654867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.655042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.655193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.655193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.655485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.655637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.655779 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.655921 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.656061 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.656201 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.656351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.656494 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.656635 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.656783 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.656925 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.657067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.657226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.657376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.657526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.657676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.657859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.658010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.658166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.658308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.658455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.658604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.658752 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.658894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.659088 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.659252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.659404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.659554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.659703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.659854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.660022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.660179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.660329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.660478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.660627 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.660782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.660931 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.661091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.661091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.661368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.661511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:53:27.661669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.661811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.661952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.661952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.662228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.662370 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.662593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.662593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.662889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.663161 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.663328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.663481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.663623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.663777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.663926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.663926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.664214 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.664214 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.664497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.664649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.664796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.664955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.665104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.665247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.665403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.665547 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.665693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.665843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.665994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.666136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.666285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.666285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.666562 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.666703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.666862 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.667073 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.667227 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.667376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.667526 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.667668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.667809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.667958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.668111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.668253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.668393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.668542 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.668690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.668855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.668998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.669155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.669310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.669469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.669782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.669948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.670093 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.670235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.670423 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.670575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.670726 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.670878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.671089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.671248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.671398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.671541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.671693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.671842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.671992 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.672141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.672141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.672420 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.672420 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.672700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.672700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.672979 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.673121 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.673262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.673413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.673555 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.673697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.673840 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.673982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.674129 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.674281 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.674431 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.674582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.674734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.674877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675513 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.675938 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676032 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676215 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676641 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.676929 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677194 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677377 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677472 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677626 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677791 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.677957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678031 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.678984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.679528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.679528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.679528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.679528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.679528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.679528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.679528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.680004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.680095 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.680417 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.680708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.680820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.681070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.681423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.681611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.681768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.682104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.682436 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.682674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.682784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.683090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.683411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.683827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.683964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.684091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.684328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.684453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.684649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.684781 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.685026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.685361 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.685464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.685715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.685878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.686037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.686187 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.686348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.686496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.686745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.686900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.687092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.687245 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.687402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.687560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.687711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.687860 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.688014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.688164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.688319 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.688491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.688649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.688799 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.688954 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.689103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.689251 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.689486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.689663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.689821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.689977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.690126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.690282 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.690451 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.690609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.690759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.690946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.691102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.691819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.691987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.692137 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.692286 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.692516 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.692674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.692870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.693037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.693244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.693401 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.693550 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.693699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.693857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.694006 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.694160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.694309 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.694465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.694614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.694780 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.694975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.695158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.695410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.695564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.695727 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.695877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.696025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.696179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.696328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.696476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.696633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.696790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.696940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.697095 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.697251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.697418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.697582 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.697731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.697953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.698104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.698259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.698408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.698568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.698716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.698864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.699065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.699216 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.699381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.699630 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.699794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.699945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.700093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.700241 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.700398 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.700554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.700703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.700851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.701006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.701156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.701318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.701489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.701646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.701803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.701952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.702102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.702258 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.702415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.702570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.702719 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.702874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.703085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.703247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.703397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.703562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.703562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.703844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.704001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.704151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.704307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.704455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.704605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.704807 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.704987 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.705147 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.705296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.705474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.705735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.705896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.706059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.706210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.706359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.706515 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.706665 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.706813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.707581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.707744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.707938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.708093 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.708249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.708464 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.708620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.708768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.708923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.709080 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.709237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.709397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.709553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.709802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.709958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.710108 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.710256 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.710419 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.710586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.710735 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.710883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.711110 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.711259 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.711430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.711582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.711737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.711886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.712034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.712191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.712340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.712498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.712654 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.712654 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.712936 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.713094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.713242 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.713390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.713537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.713692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.713841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.713998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.714146 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.714295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.714460 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.714611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.714758 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.714915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.715100 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.715251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.715399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.715547 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.715723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.715968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.716131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.716280 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.716508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.716670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.716820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.716976 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.717143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.717302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.717464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.717614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.717762 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.717911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.718058 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.718219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.718367 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.718515 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.718677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.718834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.719015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.719183 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.719341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.719491 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.719639 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.719814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.720046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.720210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.720368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.720526 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.720682 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.720843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.721001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.721158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.721314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.721474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.721623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.721771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.721928 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.722086 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.722235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.722391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.722572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.722740 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.722909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.723242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.723406 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.723567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.723756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.723920 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.724081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.724231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.724379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.724528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.724675 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.724824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.724993 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.725152 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.725301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.725450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.725604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.725768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.725917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.726179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.726344 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.726502 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.726651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.726815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.726982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.727149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.727310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.727468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.727617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.727775 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.727924 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.728072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.728220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.728220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.728512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.728670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.728827 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.728994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.729145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.729302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.729460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.729629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.731254 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.731444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.731603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.731754 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.731913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.732071 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.732231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.732388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.732551 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.732708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.732866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.733015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.733171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.733335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.733742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.733891 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.734048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.734197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.734354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.734516 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.734666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.734830 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.734995 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.735150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.735310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.735474 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.735626 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.735782 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.735939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.736088 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.736352 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.736519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.736680 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.736830 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.736998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.737149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.737312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.737469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.737619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.737777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.737935 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.738085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.738282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.738616 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.738790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.738966 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.739137 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.739305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.739466 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.739616 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.739773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.739970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.740126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.740283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.740442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.740636 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.740787 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.740944 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.741094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.741353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.741517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.741517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.741814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.741814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.742101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.742302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.742463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.742619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.742769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.742954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.743125 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.743286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.743454 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.743611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.743761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.743909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.744059 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.744220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.744370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.744526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.744676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.744824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.744985 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.745143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.745300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.745459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.745608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.745608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.745899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.745899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.746183 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.746357 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.746611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.746766 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.746977 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.747149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.747299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.747458 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.747621 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.747778 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.747936 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.748093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.748250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.748408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.748565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.748729 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.748880 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.749027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.749176 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.749325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.749484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.749714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.749872 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.750030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.750186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.750186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.750478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.750806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.751181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.751354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.751591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.751755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.751906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.752081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.752231 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.752388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.752538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.752689 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.752853 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.753010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.753166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.753330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.753489 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.753638 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.754345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.754513 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.754675 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.754825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.754994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.755149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.755311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.755461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.755618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.755767 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.755924 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.756075 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.756237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.756394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.756552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.756813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.756977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.757144 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.757294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.757450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.757608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.757765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.757922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.758143 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.758303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.758453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.758602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.758602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.758913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.759150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.759311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.759469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.759618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.759774 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.759931 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.760094 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.760251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.760400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.760548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.760829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.761002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.761161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.761310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.761459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.761635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.761856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.762031 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.762182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.762339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.762497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.762645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.762801 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.762981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.763156 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.763315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.763465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.763612 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.763760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.763924 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.764074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.764229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.764378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.764535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.764704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.764861 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.765012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.765178 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.765328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.765476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.765638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.765788 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.765943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.766100 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.766250 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.766399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.766557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.766715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.766995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.767182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.767342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.767492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.767650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.767807 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.767964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.768115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.768272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.768430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.768430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.768715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.768863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.769019 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.769188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.769348 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.770067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.770223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.770381 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.770545 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.770702 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.770861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.771038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.771198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.771350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.771499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.771646 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.771814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.772087 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.772244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.772244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.772244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.772244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.772244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.773018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.773169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.773318 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.773468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.773631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.773781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.773781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.774084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.774240 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.774391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.774553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.774703 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.774859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.775116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.775267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.775416 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.775582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.775732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.775891 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.776039 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.776195 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.776354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.776513 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.776663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.776819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.776995 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.777247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.777420 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.777573 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.777722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.777871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.778037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.778195 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.778357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.778515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.778665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.778822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.779000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.779165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.779315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.779470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.779621 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.779770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.779927 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.780087 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.780243 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.780393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.780541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.780691 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.780921 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.781074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.781250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.781490 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.781645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.781803 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.781977 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.782217 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.782388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.782539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.782687 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.782851 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.783061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.783212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.783360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.783508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.783657 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.783818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.783969 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.784117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.784276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.784433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.784433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.784733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.784885 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.785581 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.785780 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.785932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.786080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.786257 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.786531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.786700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.786850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.787730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.787907 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.788070 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.788228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.788385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.788541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.788691 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.788850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.789000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.789157 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.789307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.789455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.789610 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.789780 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.789937 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.790087 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.790236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.790236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.790534 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.790692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.790848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.791044 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.791198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.791198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.791500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.791662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.791818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.791979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.792136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.792342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.792506 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.792664 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.792813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.792962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.793110 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.793259 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.793422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.793572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.793745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.793895 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.794044 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.794207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.794358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.794507 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.794663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.794820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.794987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.795155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.795306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.795463 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.795620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.795779 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.795935 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.796099 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.796249 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.796398 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.796571 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.796797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.796959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.797124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.797273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.797430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.797581 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.797755 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.798002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.798166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.798322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.798479 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.798637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.798787 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.798968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.799143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.799296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.799444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.799602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.799752 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.799919 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.800078 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.800235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.800385 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.800534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.800736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.801395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.801554 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.801778 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.801946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.802104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.802269 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.802420 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.802579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.802737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.802893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.803090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.803252 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.803410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.803565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.803715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.803873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.804030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.804227 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.804389 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.804561 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.804746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.804975 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.805155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.805315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.805465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.805621 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.805778 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.805778 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.806076 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.806237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.806394 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.806560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.806717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.806978 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.807150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.807302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.807451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.807451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.807451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.807885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.808063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.808299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.808461 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.808620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.808781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.808939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.809091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.809247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.809404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.809554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.809709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.809874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.810031 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.810189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.810346 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.810496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.810496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.810806 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.811010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.811167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.811328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.811478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.811636 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.811794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.811794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.812082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.812082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.812374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.812603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.812765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.812922 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.813079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.813229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.813377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.813535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.813691 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.813841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.813997 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.814146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.814315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.814475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.814625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.814790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.814958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.815114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.815280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.815439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.815595 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.815745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.815894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.816042 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.816199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.816437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.816658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.816893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.817207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.817207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.817526 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.817677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.817677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.817970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.818126 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.818306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.818556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.818710 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.818868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.819083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.819247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.819406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.819572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.819731 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.819889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.820046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.820203 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.820367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.820518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.820667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.820815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.820965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.821125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.821874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.822040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.822205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.822356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.822505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.822655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.822655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.822967 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.823384 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.823550 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.823714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.823917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.824074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.824243 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.824403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.824554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.824711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.824870 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.825023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.825182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.825340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.825497 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.825666 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.825818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.825967 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.826130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.826280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.826437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.826599 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.826751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.826909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.827137 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.827395 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.827558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.827709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.827870 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.828034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.828192 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.828349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.828499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.828770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.828770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.829084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.829235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.829392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.829550 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.829708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.829904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.830198 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.830369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.830369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.830678 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.831454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.831639 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.831805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.832531 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.832698 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.832850 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833330 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833636 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833787 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.833943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.834348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.834510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.834668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.834668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.835546 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.835708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.835866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.836028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.837007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.837174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.837339 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.837603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.837913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.838068 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.838230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.838391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.838551 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.838766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.838984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.839166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.839325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.839512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.839673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.839824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.839980 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840743 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.840892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.841351 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.841508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.841669 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.841820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.841975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.842125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.842286 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.842435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.842593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.842751 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.842751 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.843860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.844287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.844435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.844592 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.844742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.844904 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.845063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.845220 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.845377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.845377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.845662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.845882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.846042 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.846192 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.846348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.846506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.846667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.846818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.847071 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.847247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.847398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.847398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.848576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.848662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.848746 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.848828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.848909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.848989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849075 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849561 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849646 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849804 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.849882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850021 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850241 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850392 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850696 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850774 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850853 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.850973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851064 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851147 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851305 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851384 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.851982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852051 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852126 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852644 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852860 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.852938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853074 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853240 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853610 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853873 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.853992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854113 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854217 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854652 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854744 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.854979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855502 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855587 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855753 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.855941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856032 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856217 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856564 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.856785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.857005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.857112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.857328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.857423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.857645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.857738 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.857963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.858073 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.858303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.858715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.858839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.858997 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.859192 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.859300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.859518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.859662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.859852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.859980 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.860176 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.860325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.860597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.860769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.860931 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.861662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.861662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.861974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.862133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.862283 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.862431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.862580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.862769 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.862996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.863193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.863435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.863645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.863812 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.863965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864613 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864613 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864831 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.864949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.865061 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.865156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.865243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.865469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.865572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.865794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.865894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.866111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.866203 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.866447 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.866546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.866784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.866876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.867151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.867269 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.867489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.867595 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.867807 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.867996 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.868183 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.868559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.868747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.869213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.869383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.869535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.869697 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.869848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.870006 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.870166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.870316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.870531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.870694 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.870845 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.871034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.871190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 10:53:27.871340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.871340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.871340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.871779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.871779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.872065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.872378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.872696 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.873009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.873322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.873638 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.873989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.874443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.874770 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.875121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.875442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.875760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.876112 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.876457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.876785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.877122 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.877443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.877777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.878098 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.878432 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.878831 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.879255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.879473 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.879822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.880145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.880464 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.880784 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.881104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.881433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.881755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.882098 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.882436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.882752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.883115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.883443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.883779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.884111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.884462 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.884803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.885123 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.885542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.885864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.886348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.886677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.887036 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.887380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.887682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.888009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.888338 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.888681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.889017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.889397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.889673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.890012 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.890374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.890699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.891194 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.891540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.891868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.892189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.892508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:53:27.892762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 10:53:28.024912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Registered counter for database nova_api Aug 07 10:53:28.045331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.045692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Registered counter for database nova_api Aug 07 10:53:28.052099 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.065262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.072182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.110421 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.context [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf8b7f3-2643-43e0-8bb5-27854ec1f83d(cell1) {{(pid=117615) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 10:53:28.114700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:53:28.115210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:53:28.116814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:53:28.117557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:53:28.118014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:53:28.120044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:53:28.122063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Registered counter for database nova_cell0 Aug 07 10:53:28.126234 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Registered counter for database nova_cell1 Aug 07 10:53:28.129509 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.context [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cf8b7f3-2643-43e0-8bb5-27854ec1f83d(cell1) {{(pid=117616) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 10:53:28.133636 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:53:28.133811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.134133 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:53:28.135305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.135802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:53:28.136568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:53:28.137155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:53:28.139656 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:53:28.141960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Registered counter for database nova_cell0 Aug 07 10:53:28.142098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.143407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.146957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Registered counter for database nova_cell1 Aug 07 10:53:28.154164 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.156413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.161707 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.291523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO dbcounter [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Registered counter for database nova_cell0 Aug 07 10:53:28.298591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.300838 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.303900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writer thread running {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.310862 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO dbcounter [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Registered counter for database nova_cell0 Aug 07 10:53:28.319101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:53:28.324133 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writer thread running {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:53:28.634004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:53:28.641853 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:53:28.653193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:53:28.661154 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:53:28.992043 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:53:28.997943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-7ae60920-55b4-44a9-8d2c-c7644d0534fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:53:29.004689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628bf71e9c0 pid: 117615 (default app) Aug 07 10:53:29.008975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 10:53:29.015057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-274c6c74-f89c-4898-b5cc-ea82e3986e5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 10:53:29.022269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628bf71e9c0 pid: 117616 (default app) Aug 07 10:54:04.151496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:04.152374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:04.153139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:04.154124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:04.453766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:04.454603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:04.455395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:04.456133 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:05.452088 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-44f292d5-2251-4a88-b92c-1697ab99b4c8 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Action: 'create', calling method: .version_select at 0x7fc5ef985dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2036507196", "metadata": {"Type": "work"}}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:05.844217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2efe4392-97c8-45f8-8080-9f66e8da2855 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Action: 'create', calling method: .version_select at 0x7fc5ef986dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1448687366"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:07.350959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2efe4392-97c8-45f8-8080-9f66e8da2855 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.902670 Aug 07 10:54:07.351949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Sun Aug 7 10:54:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2905 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 07 10:54:07.367387 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e281427e-1d35-485a-9d4e-785af7fa97ce tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef876c10>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:07.378412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-44f292d5-2251-4a88-b92c-1697ab99b4c8 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.240274 Aug 07 10:54:07.379079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Aug 7 10:54:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3242 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 10:54:07.396800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e078a392-d009-4264-874b-38964e9353ab tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Calling method '.version_select at 0x7fc5ef876c10>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:07.535205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e281427e-1d35-485a-9d4e-785af7fa97ce tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 200 len: 345 microversion: 2.1 time: 0.172055 Aug 07 10:54:07.536250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:07 2022] GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:07.637781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e078a392-d009-4264-874b-38964e9353ab tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b" status: 200 len: 353 microversion: 2.1 time: 0.248221 Aug 07 10:54:07.644350 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:07 2022] GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:08.553651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bd82d9a9-f200-450b-90dc-b4d02686fa72 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef815310>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:08.652662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-956c5355-7ed0-433a-b31d-a56e7c9b00f1 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Calling method '.version_select at 0x7fc5ef818310>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:08.656464 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bd82d9a9-f200-450b-90dc-b4d02686fa72 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 200 len: 345 microversion: 2.1 time: 0.111421 Aug 07 10:54:08.657028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:08 2022] GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:08.729908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-956c5355-7ed0-433a-b31d-a56e7c9b00f1 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b" status: 200 len: 353 microversion: 2.1 time: 0.082273 Aug 07 10:54:08.730659 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:08 2022] GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:54:09.671842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d192ca7a-aff7-415e-a39f-b04372d6185a tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef8159d0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:09.749529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5bb12f8f-f318-406c-8f07-556144732211 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Calling method '.version_select at 0x7fc5ef8189d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:09.806310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d192ca7a-aff7-415e-a39f-b04372d6185a tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 200 len: 346 microversion: 2.1 time: 0.138869 Aug 07 10:54:09.807197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:09 2022] GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 346 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:09.820773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fff45255-641a-426d-9fbc-70761df956c7 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Action: 'create', calling method: .version_select at 0x7fc5ef876e50>, body: {"snapshot": {"volume_id": "469cdf04-e8a2-45d2-b67b-176ce65800d3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1659460925"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:09.921406 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5bb12f8f-f318-406c-8f07-556144732211 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b" status: 200 len: 354 microversion: 2.1 time: 0.176398 Aug 07 10:54:09.922423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:09 2022] GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:09.934170 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7ef1fa07-9d49-4f9e-ac3b-5e3b0e503123 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Calling method '.version_select at 0x7fc5ef876dc0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:10.131883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7ef1fa07-9d49-4f9e-ac3b-5e3b0e503123 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b" status: 200 len: 354 microversion: 2.1 time: 0.201282 Aug 07 10:54:10.142976 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:09 2022] GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:10.183889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b48113e5-e03f-436a-9959-c3227a5331fc tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Calling method '.version_select at 0x7fc5ef818a60>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:10.448139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fff45255-641a-426d-9fbc-70761df956c7 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.631514 Aug 07 10:54:10.448963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 5/10] 10.222.0.25 () {60 vars in 1162 bytes} [Sun Aug 7 10:54:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:54:10.464244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-13d1dc74-93ba-469d-bc68-3be4ca2e7452 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef815e50>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:10.470151 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b48113e5-e03f-436a-9959-c3227a5331fc tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b" status: 202 len: 0 microversion: 2.1 time: 0.319994 Aug 07 10:54:10.472116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 10:54:10 2022] DELETE /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:54:10.479938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dd088f87-dabf-443d-8f22-c3d71f14b5c1 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Calling method '.version_select at 0x7fc5ef818310>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:10.617275 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-13d1dc74-93ba-469d-bc68-3be4ca2e7452 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.158894 Aug 07 10:54:10.617915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:10 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:10.629103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-345cff4e-797e-49a5-9d8b-f4071fe41b23 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef81f4c0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:10.745154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dd088f87-dabf-443d-8f22-c3d71f14b5c1 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b" status: 200 len: 353 microversion: 2.1 time: 0.269015 Aug 07 10:54:10.747047 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:10 2022] GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b => generated 353 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:10.747886 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-345cff4e-797e-49a5-9d8b-f4071fe41b23 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.122688 Aug 07 10:54:10.749025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Aug 7 10:54:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:54:10.762463 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2b3c0ba1-fb50-48f7-ae4c-b97b29675ddb tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef818040>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:10.821379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2b3c0ba1-fb50-48f7-ae4c-b97b29675ddb tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.062563 Aug 07 10:54:10.822175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:10 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:11.766055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e4b1b3fe-e82e-4c80-92ef-e73a6cf6cd29 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Calling method '.version_select at 0x7fc5ef81faf0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:11.821637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-e4b1b3fe-e82e-4c80-92ef-e73a6cf6cd29 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] HTTP exception thrown: Volume 31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b could not be found. Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e4b1b3fe-e82e-4c80-92ef-e73a6cf6cd29 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Request method failure captured: Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b HTTP/1.1 Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nMj_Nyd1yGpz9uiL9nsDiZuTOrX0XS_Hcfq58pndPcAYx_sg4eslRt4egXxEhvNwx6aCndr53LdykDDzYPBCglgQld4UWg-z8HUM1Y-IODpo52UcpyRyBGJiHkgqMIbJjQJg366RwEJmSzSHdsqyOAhyouLIJT0BU27u0dRIT4z-o Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: d16deb58b3724c8191e1e251a4e915f0 Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesGetTestJSON-2038507720 Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 10:54:11.826885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d16deb58b3724c8191e1e251a4e915f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d16deb58b3724c8191e1e251a4e915f0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16deb58b3724c8191e1e251a4e915f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d16deb58b3724c8191e1e251a4e915f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesGetTestJSON-2038507720 Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: d16deb58b3724c8191e1e251a4e915f0 Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesGetTestJSON-2038507720 Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesGetTestJSON-2038507720-project Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 12de1ec12eb746bc9bb163bff5b464ed Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesGetTestJSON-2038507720-project Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Volume 31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b could not be found. Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b'} Aug 07 10:54:11.828645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b could not be found. (HTTP 404) (Request-ID: req-ac091b68-f18c-4486-a27d-40e8973e14c4) Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:11.829337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:11.831856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b could not be found. Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 10:54:11.834273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b could not be found. Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b could not be found. Aug 07 10:54:11.836720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:11.838520 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-51a45b3b-92fa-40b0-8b29-e38c33ee2fe2 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef818940>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:11.839758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e4b1b3fe-e82e-4c80-92ef-e73a6cf6cd29 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] Returning 404 to user: Volume 31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:54:11.840922 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e4b1b3fe-e82e-4c80-92ef-e73a6cf6cd29 tempest-VolumesGetTestJSON-2038507720 tempest-VolumesGetTestJSON-2038507720-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b" status: 404 len: 109 microversion: 2.1 time: 0.078704 Aug 07 10:54:11.842247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:11 2022] GET /compute/v2.1/os-volumes/31dc0afc-b20a-4f7c-b4ca-f5058ff30a6b => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:54:11.898202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-51a45b3b-92fa-40b0-8b29-e38c33ee2fe2 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.066484 Aug 07 10:54:11.899427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:11 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:12.913836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-20cc9709-0421-4bad-b9ef-e26bdf72a9ed tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef81f430>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:12.959233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-20cc9709-0421-4bad-b9ef-e26bdf72a9ed tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.051458 Aug 07 10:54:12.960313 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:12 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:13.973028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9dcde4b2-bc96-4f6d-bc05-9ec289c08fd5 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef876af0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:14.026177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9dcde4b2-bc96-4f6d-bc05-9ec289c08fd5 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.057508 Aug 07 10:54:14.026968 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:13 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:14.486791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-245400397", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:14.699908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] validate_networks() for [('506b3088-03b1-4569-bcdb-92d73b15b685', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:54:15.039862 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-011cf10e-3f2a-44a2-b403-c9b2af7a4431 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef876dc0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:15.087759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-011cf10e-3f2a-44a2-b403-c9b2af7a4431 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.052075 Aug 07 10:54:15.092798 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 11/20] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:15 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:16.100532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-44de341e-4f7f-44d4-82a6-cfa23b4c00c5 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef818a60>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:16.214413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-44de341e-4f7f-44d4-82a6-cfa23b4c00c5 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.111341 Aug 07 10:54:16.215579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 12/21] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:16 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:16.692918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:54:16.693449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:54:16.693934 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:54:16.694355 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:54:16.694780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:54:16.736863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:16.737630 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:16.738290 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:16.742598 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:16.743474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:16.744070 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:16.860216 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for project 9df6ca365836428198f2d20fd9829feb. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:54:16.922894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for user c3a12c3144844d32812e010550bb0921 and project 9df6ca365836428198f2d20fd9829feb. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:54:16.969900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:54:16.980159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:54:17.203027 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8d198528-c201-4761-bd9c-9b6250e4bdb2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.991059 Aug 07 10:54:17.204167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 10/22] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:54:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 10:54:17.216417 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5a75c46-e1d3-4bde-8e3d-6f37a4caad73 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:17.217162 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5a75c46-e1d3-4bde-8e3d-6f37a4caad73 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:17.229032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-09e1dad7-bb71-4e68-82de-cca1ddf59a24 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee7b8b0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:17.325542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-09e1dad7-bb71-4e68-82de-cca1ddf59a24 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 288 microversion: 2.1 time: 0.101204 Aug 07 10:54:17.332800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:17 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:54:17.337605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-29991179-789a-4f2d-bb72-3b40990cf4c3 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee92040>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:17.489540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-29991179-789a-4f2d-bb72-3b40990cf4c3 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 202 len: 0 microversion: 2.1 time: 0.155715 Aug 07 10:54:17.493540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Aug 7 10:54:17 2022] DELETE /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:54:17.499042 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8e48fdc9-33cb-4060-9666-11c62a779f53 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee92700>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:17.559094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8e48fdc9-33cb-4060-9666-11c62a779f53 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.064086 Aug 07 10:54:17.565903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:17 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:17.746335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5a75c46-e1d3-4bde-8e3d-6f37a4caad73 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:17.782437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5a75c46-e1d3-4bde-8e3d-6f37a4caad73 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1221 microversion: 2.1 time: 0.567408 Aug 07 10:54:17.784081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:17 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1221 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:18.102300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-854297018", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:18.230908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] validate_networks() for [('506b3088-03b1-4569-bcdb-92d73b15b685', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:54:18.574855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7f12c3c0-15de-411f-bbbd-64798038b65d tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef824940>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:18.682149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7f12c3c0-15de-411f-bbbd-64798038b65d tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.111579 Aug 07 10:54:18.683782 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:18 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:54:19.282733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:54:19.284560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:54:19.285465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:54:19.286229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:54:19.287291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:54:19.312539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:19.316677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:19.319267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:19.323795 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:19.324957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:19.327747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:19.387148 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for project 9df6ca365836428198f2d20fd9829feb. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:54:19.410558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for user c3a12c3144844d32812e010550bb0921 and project 9df6ca365836428198f2d20fd9829feb. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:54:19.443868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:54:19.451974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:54:19.631294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cb358c43-4f6d-40d5-920c-1e749dd6dff0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.531241 Aug 07 10:54:19.640315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 14/28] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:54:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:54:19.647493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-76b12016-de50-49b9-8e2d-4b675930a7af tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:19.648828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-76b12016-de50-49b9-8e2d-4b675930a7af tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:19.698983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a79597a8-4aaf-49a0-bda9-b122bb45726b tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee92af0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:19.805732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a79597a8-4aaf-49a0-bda9-b122bb45726b tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.108739 Aug 07 10:54:19.816418 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:19 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:19.828171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-76b12016-de50-49b9-8e2d-4b675930a7af tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:19.838820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-76b12016-de50-49b9-8e2d-4b675930a7af tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1221 microversion: 2.1 time: 0.199360 Aug 07 10:54:19.853976 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 15/30] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:19 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1221 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:20.821157 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1d57d431-80d8-4c11-81fa-34f8af098df4 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee92160>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:20.879481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-363d64eb-41cb-43fc-83af-7f4b3d8158ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:20.880797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-363d64eb-41cb-43fc-83af-7f4b3d8158ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:21.048140 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1d57d431-80d8-4c11-81fa-34f8af098df4 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 200 len: 287 microversion: 2.1 time: 0.232067 Aug 07 10:54:21.054059 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 16/31] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:20 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 287 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:21.069177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-363d64eb-41cb-43fc-83af-7f4b3d8158ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:21.082658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-363d64eb-41cb-43fc-83af-7f4b3d8158ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1221 microversion: 2.1 time: 0.207190 Aug 07 10:54:21.087549 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 16/32] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:20 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1221 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:21.953094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-54e5bb5b-3ef8-451f-b9e2-8c81ea26d23e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'create', calling method: .version_select at 0x7fc5eee921f0>, body: {"keypair": {"name": "tempest-keypair-2125088591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXOn5TjoOS+IWcJ4jHGYltrRswbiyy0SL3txsYnekByxLfMmlBCyDTB5dIqeNWWd/4AWI72/GK0J68Jn3y2Zv9qWhm63Pz6Mfg5YyDgYd3KpbcEoCK/wYq4WADK75qgOA=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:22.061686 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fb0781fc-d861-4acd-b7b9-e9e53fbd160b tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef7e7670>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:22.092665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-54e5bb5b-3ef8-451f-b9e2-8c81ea26d23e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:54:22.129980 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-54e5bb5b-3ef8-451f-b9e2-8c81ea26d23e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for user 2b757e3f47e44b9ba3645d12b20f7502 and project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:54:22.216549 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-fb0781fc-d861-4acd-b7b9-e9e53fbd160b tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] HTTP exception thrown: Snapshot ccd6ceb4-5540-41a4-8b38-2d330f2307de could not be found. Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fb0781fc-d861-4acd-b7b9-e9e53fbd160b tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Request method failure captured: Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de HTTP/1.1 Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nMXohQ_izmbfra_a9aL0cXj7DnffV33G8W8_nj68iepD7G2_9P2P2RX8VS5XNDLQMEAtjAoZwIIF3maiwwUIfXwrpjSIGSdnbBg1xj4KSe3fWgQf1Rsu-bPIkC_CsvKFxNYxtKCEE4AmseORf7gemErOVeOg2I-TJsNqKQyX9Dnvs Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:54:22.221711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_639f69c020004f59b20d086d5f4149e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 60bf4ef3bca04a418ee55888f86384b1 Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Snapshot ccd6ceb4-5540-41a4-8b38-2d330f2307de could not be found. Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': 'ccd6ceb4-5540-41a4-8b38-2d330f2307de'} Aug 07 10:54:22.222962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ccd6ceb4-5540-41a4-8b38-2d330f2307de could not be found. (HTTP 404) (Request-ID: req-35eff14b-94df-4b15-8fd3-3ff6d9b01f62) Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:22.223859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:22.224765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ccd6ceb4-5540-41a4-8b38-2d330f2307de could not be found. Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 07 10:54:22.225642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ccd6ceb4-5540-41a4-8b38-2d330f2307de could not be found. Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ccd6ceb4-5540-41a4-8b38-2d330f2307de could not be found. Aug 07 10:54:22.226793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:22.230676 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fb0781fc-d861-4acd-b7b9-e9e53fbd160b tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Returning 404 to user: Snapshot ccd6ceb4-5540-41a4-8b38-2d330f2307de could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:54:22.235093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fb0781fc-d861-4acd-b7b9-e9e53fbd160b tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de" status: 404 len: 111 microversion: 2.1 time: 0.174534 Aug 07 10:54:22.242051 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1251 bytes} [Sun Aug 7 10:54:22 2022] GET /compute/v2.1/os-snapshots/ccd6ceb4-5540-41a4-8b38-2d330f2307de => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:54:22.258634 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:22.259238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:22.261675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-54e5bb5b-3ef8-451f-b9e2-8c81ea26d23e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.890285 Aug 07 10:54:22.263245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 17/34] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Aug 7 10:54:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 899 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 10:54:22.268805 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-54b1051c-b814-4d4b-9f0e-9814c130f4d4 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee92dc0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:22.288514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:22.291171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:22.291924 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:22.292868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:22.296449 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:22.297145 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:22.443498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-54b1051c-b814-4d4b-9f0e-9814c130f4d4 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 202 len: 0 microversion: 2.1 time: 0.178532 Aug 07 10:54:22.444158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 10:54:22 2022] DELETE /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:54:22.453881 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c0e155ac-fdf5-4735-9bef-1bd2c78bfc47 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee7bc10>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:22.620737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c0e155ac-fdf5-4735-9bef-1bd2c78bfc47 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 200 len: 345 microversion: 2.1 time: 0.171517 Aug 07 10:54:22.631797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 19/36] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:22 2022] GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:22.778025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:22.797567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-227aed4c-f23e-41d2-b9f3-9f8637cff7f3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1217 microversion: 2.1 time: 0.553469 Aug 07 10:54:22.798557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 18/37] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:22 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1217 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:23.650610 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a1a25de7-97a4-4849-8e9a-bd5d46d5b63c tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5eee92700>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:23.797552 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-a1a25de7-97a4-4849-8e9a-bd5d46d5b63c tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] HTTP exception thrown: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a1a25de7-97a4-4849-8e9a-bd5d46d5b63c tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Request method failure captured: Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 HTTP/1.1 Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nMXohQ_izmbfra_a9aL0cXj7DnffV33G8W8_nj68iepD7G2_9P2P2RX8VS5XNDLQMEAtjAoZwIIF3maiwwUIfXwrpjSIGSdnbBg1xj4KSe3fWgQf1Rsu-bPIkC_CsvKFxNYxtKCEE4AmseORf7gemErOVeOg2I-TJsNqKQyX9Dnvs Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 10:54:23.800425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_639f69c020004f59b20d086d5f4149e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 60bf4ef3bca04a418ee55888f86384b1 Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '469cdf04-e8a2-45d2-b67b-176ce65800d3'} Aug 07 10:54:23.801644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. (HTTP 404) (Request-ID: req-59d89034-4cfd-4bd2-b25c-9f20fe295907) Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:23.802442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:23.803380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 10:54:23.804298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:23.805253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:54:23.807688 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a1a25de7-97a4-4849-8e9a-bd5d46d5b63c tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Returning 404 to user: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:54:23.809011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a1a25de7-97a4-4849-8e9a-bd5d46d5b63c tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 404 len: 109 microversion: 2.1 time: 0.176158 Aug 07 10:54:23.810107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:23 2022] GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 109 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:54:23.833551 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-665a8fc7-9b25-4db2-9c2c-b55f91b9faf2 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef6c2a60>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:23.844918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:23.851052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:23.963276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:23.964837 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:23.966201 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:23.974483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:23.978705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:23.980419 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:24.000667 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-665a8fc7-9b25-4db2-9c2c-b55f91b9faf2 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] HTTP exception thrown: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-665a8fc7-9b25-4db2-9c2c-b55f91b9faf2 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Request method failure captured: Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 HTTP/1.1 Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nMXohQ_izmbfra_a9aL0cXj7DnffV33G8W8_nj68iepD7G2_9P2P2RX8VS5XNDLQMEAtjAoZwIIF3maiwwUIfXwrpjSIGSdnbBg1xj4KSe3fWgQf1Rsu-bPIkC_CsvKFxNYxtKCEE4AmseORf7gemErOVeOg2I-TJsNqKQyX9Dnvs Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:54:24.004500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_639f69c020004f59b20d086d5f4149e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 60bf4ef3bca04a418ee55888f86384b1 Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '469cdf04-e8a2-45d2-b67b-176ce65800d3'} Aug 07 10:54:24.005867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. (HTTP 404) (Request-ID: req-c86103e3-9349-4d78-8a28-6a4812a2ce93) Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:24.006680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 10:54:24.007933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 10:54:24.009070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-665a8fc7-9b25-4db2-9c2c-b55f91b9faf2 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Returning 404 to user: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-665a8fc7-9b25-4db2-9c2c-b55f91b9faf2 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 404 len: 109 microversion: 2.1 time: 0.186112 Aug 07 10:54:24.010166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 19/39] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 10:54:23 2022] DELETE /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 109 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:54:24.033097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0d505b1c-2c0a-4be0-85f7-e6b19987a025 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Calling method '.version_select at 0x7fc5ef6c2b80>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:24.174603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-0d505b1c-2c0a-4be0-85f7-e6b19987a025 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] HTTP exception thrown: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0d505b1c-2c0a-4be0-85f7-e6b19987a025 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Request method failure captured: Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 HTTP/1.1 Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nMXohQ_izmbfra_a9aL0cXj7DnffV33G8W8_nj68iepD7G2_9P2P2RX8VS5XNDLQMEAtjAoZwIIF3maiwwUIfXwrpjSIGSdnbBg1xj4KSe3fWgQf1Rsu-bPIkC_CsvKFxNYxtKCEE4AmseORf7gemErOVeOg2I-TJsNqKQyX9Dnvs Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:54:24.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_639f69c020004f59b20d086d5f4149e5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/639f69c020004f59b20d086d5f4149e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 639f69c020004f59b20d086d5f4149e5 Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-754500799 Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 60bf4ef3bca04a418ee55888f86384b1 Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-754500799-project Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '469cdf04-e8a2-45d2-b67b-176ce65800d3'} Aug 07 10:54:24.178030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. (HTTP 404) (Request-ID: req-9d2c70d2-9974-448c-b010-07ff42cf784d) Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:24.178807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 10:54:24.183028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 10:54:24.184986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0d505b1c-2c0a-4be0-85f7-e6b19987a025 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] Returning 404 to user: Volume 469cdf04-e8a2-45d2-b67b-176ce65800d3 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0d505b1c-2c0a-4be0-85f7-e6b19987a025 tempest-VolumesSnapshotsTestJSON-754500799 tempest-VolumesSnapshotsTestJSON-754500799-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3" status: 404 len: 109 microversion: 2.1 time: 0.163324 Aug 07 10:54:24.186188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 10:54:24 2022] GET /compute/v2.1/os-volumes/469cdf04-e8a2-45d2-b67b-176ce65800d3 => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:54:24.748883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:24.804435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-40586453-7b72-4986-92f5-5844ce8687d9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1279 microversion: 2.1 time: 0.972391 Aug 07 10:54:24.821101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 21/41] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:23 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1279 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:25.564881 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-918918339", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "networks": [{"uuid": "6fc23922-020f-457f-85d3-5ce1087b0ada"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:25.828666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:25.830295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:25.841981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:25.848197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:25.851026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:25.853147 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:25.856371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:25.859853 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:25.953268 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] validate_networks() for [('6fc23922-020f-457f-85d3-5ce1087b0ada', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:54:26.579727 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:26.597718 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e3dad1ce-f3ee-4861-bd35-8cd1a370b625 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1279 microversion: 2.1 time: 0.772838 Aug 07 10:54:26.600835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 22/42] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:25 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1279 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:27.622550 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:27.623397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:27.670430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:27.674311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:27.675334 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:27.679179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:27.681448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:27.682373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:28.122848 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:28.135646 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-51c3d08a-8473-4dca-9378-6f306bc74af8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1279 microversion: 2.1 time: 0.518544 Aug 07 10:54:28.144308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:27 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1279 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:29.164098 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:29.176721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:29.198223 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:29.199303 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:29.199999 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:29.200962 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:29.201757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:29.202410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:29.349903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:31.029887 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:31.044039 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48a93724-ac2d-4d2d-8253-1db94766fe40 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 1.884091 Aug 07 10:54:31.068961 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 24/44] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:29 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:31.081934 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:31.523265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33d6cf72-3dc0-4c38-904b-0857acdab2e9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'create', calling method: .version_select at 0x7fc5edda1940>, body: {"keypair": {"name": "tempest-keypair-893025530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCny8TIjHq/46vzKzECntWipaUIiCBmMx+Xw5XiHz67t2+akNMoD8L6fiYoEsIxyfC4PH0so2Qc4eaqU1NCdRLutyM3/uAbPER7v+Ty64evbT3bqcUXsYxjJIVhc3UIaSw=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:31.564306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-33d6cf72-3dc0-4c38-904b-0857acdab2e9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:54:31.574659 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-33d6cf72-3dc0-4c38-904b-0857acdab2e9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for user 2b64b05230b940eba992a063ea7cd778 and project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:54:31.646250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33d6cf72-3dc0-4c38-904b-0857acdab2e9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.575120 Aug 07 10:54:31.647917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 25/45] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 10:54:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:32.080418 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:32.081246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:32.092132 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:32.092812 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:32.093342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:32.094315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:32.095168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:32.095928 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:32.786709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:32.807618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:54:32.808528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:54:32.809248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:54:32.809866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:54:32.810490 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:54:32.856396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:32.858814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:32.863602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:32.866990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:32.870228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:32.871199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:33.029871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Getting quotas for project 2d2c614e07df4a29b2cd84c260fdc93a. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:54:33.076993 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Getting quotas for user 616a497708664cca8bf7cfe93cbfd01f and project 2d2c614e07df4a29b2cd84c260fdc93a. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:54:33.146904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:54:33.155521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:54:33.449800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eab96ec9-25de-43c4-8d1d-4e3ad9499093 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.114552 Aug 07 10:54:33.451894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 21/46] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 8120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:54:33.472385 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1745893742", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b8ae6a5-9495-4ad7-8f30-6fd8ff3dd376"}], "security_groups": [{"name": "tempest-securitygroup--1453402370"}], "key_name": "tempest-keypair-2125088591", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:33.517083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:33.526436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db053d72-11ac-4e25-bdf4-6cf02f18b184 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 1.455234 Aug 07 10:54:33.536949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 26/47] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:32 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:33.571357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c5700da9-f3c5-413d-8b09-ba2c46a5d8a0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:33.577120 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c5700da9-f3c5-413d-8b09-ba2c46a5d8a0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:34.407139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c5700da9-f3c5-413d-8b09-ba2c46a5d8a0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:34.448795 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c5700da9-f3c5-413d-8b09-ba2c46a5d8a0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1214 microversion: 2.1 time: 0.909306 Aug 07 10:54:34.458939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 27/48] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:33 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1214 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:34.558801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:34.561006 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:34.570239 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:34.577706 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:34.580718 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:34.584073 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:34.586457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:34.588951 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:34.890212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] validate_networks() for [('4b8ae6a5-9495-4ad7-8f30-6fd8ff3dd376', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:54:36.097444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:36.115230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2e944b6a-2272-4045-8298-7d4e6f2457b4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 1.560073 Aug 07 10:54:36.117765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 28/49] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:34 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:37.028493 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-ffd4ac3a-3cf0-4ece-9f45-a7ac2c4d3103 req-be319504-3b39-4076-a99b-012b670f3edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e465ec9d-f167-4410-b5dd-95c885e888a4", "tag": "fe5bcaad-6e9a-4fc9-a938-a0811d665192"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:37.062714 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ffd4ac3a-3cf0-4ece-9f45-a7ac2c4d3103 req-be319504-3b39-4076-a99b-012b670f3edd service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:37.062816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ffd4ac3a-3cf0-4ece-9f45-a7ac2c4d3103 req-be319504-3b39-4076-a99b-012b670f3edd service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:37.077278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ffd4ac3a-3cf0-4ece-9f45-a7ac2c4d3103 req-be319504-3b39-4076-a99b-012b670f3edd service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:37.137419 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-ffd4ac3a-3cf0-4ece-9f45-a7ac2c4d3103 req-be319504-3b39-4076-a99b-012b670f3edd service nova] Creating event network-changed:fe5bcaad-6e9a-4fc9-a938-a0811d665192 for instance e465ec9d-f167-4410-b5dd-95c885e888a4 on hv-cinder-85032 Aug 07 10:54:37.138184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ffd4ac3a-3cf0-4ece-9f45-a7ac2c4d3103 req-be319504-3b39-4076-a99b-012b670f3edd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 10:54:37.138281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ffd4ac3a-3cf0-4ece-9f45-a7ac2c4d3103 req-be319504-3b39-4076-a99b-012b670f3edd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 10:54:37.147222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:37.147722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:37.148168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:37.152825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:37.153311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:37.159584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:37.194026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.compute.rpcapi [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 10:54:37.194970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] Releasing lock "compute-rpcapi-router" {{(pid=117616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 10:54:37.271340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5463cb49-5a2e-4bc0-aaba-4f29e8691176 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.152117 Aug 07 10:54:37.272260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 29/50] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:37.278278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:37.279915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:37.288440 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:37.290220 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:37.290835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:37.292017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:37.292584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:37.293026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:37.923626 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:37.939259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a0be16aa-e07c-40cb-9050-5010cad7b42f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1272 microversion: 2.1 time: 0.663157 Aug 07 10:54:37.957595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 30/51] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:37 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1272 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:37.991061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:37.991881 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:38.002342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:38.006553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:38.012298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:38.014257 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:38.019373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:38.020034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:40.028716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:54:40.029320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:54:40.029835 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:54:40.030478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:54:40.031444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:54:40.054338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:40.057860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:40.058433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:40.059867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:40.062068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:40.062610 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:40.110705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:54:40.128133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for user 2b757e3f47e44b9ba3645d12b20f7502 and project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:54:40.141818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:54:40.146584 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:54:40.228868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:40.247926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ec9c83d8-c4f2-4d9e-aa71-7997eb1272ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 2.281515 Aug 07 10:54:40.247926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 31/52] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:37 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:40.250888 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:40.255485 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:40.265776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a34b3f43-c633-4c50-bd81-482c578d7ca9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.807641 Aug 07 10:54:40.271843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:40.272335 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:40.272903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 22/53] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Aug 7 10:54:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 6820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 10:54:40.285851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:40.292583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-645460811", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0162d8c1-679d-4577-b6e5-f73e9ca72395"}], "security_groups": [{"name": "tempest-securitygroup--1515520444"}], "key_name": "tempest-keypair-893025530", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:40.302593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:40.303884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:40.304460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:40.854266 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] validate_networks() for [('0162d8c1-679d-4577-b6e5-f73e9ca72395', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:54:40.936642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:40.947096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3702034d-535b-4994-8754-72b97610cb11 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.702813 Aug 07 10:54:40.948049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 32/54] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:40 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:40.954698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5bc3f2a3-218a-414e-b977-274d99ec027a req-22d591d6-0a21-4d44-a034-1621065e87ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f67c015-509d-42e7-b1fb-0b70bdafefa9", "tag": "0a235f8a-de93-40e4-8382-67cb77a1c7e4"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:40.965748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5bc3f2a3-218a-414e-b977-274d99ec027a req-22d591d6-0a21-4d44-a034-1621065e87ad service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:40.966480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5bc3f2a3-218a-414e-b977-274d99ec027a req-22d591d6-0a21-4d44-a034-1621065e87ad service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:40.967110 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5bc3f2a3-218a-414e-b977-274d99ec027a req-22d591d6-0a21-4d44-a034-1621065e87ad service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:40.980628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5bc3f2a3-218a-414e-b977-274d99ec027a req-22d591d6-0a21-4d44-a034-1621065e87ad service nova] Creating event network-changed:0a235f8a-de93-40e4-8382-67cb77a1c7e4 for instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 on hv-cinder-85032 Aug 07 10:54:40.987069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5bc3f2a3-218a-414e-b977-274d99ec027a req-22d591d6-0a21-4d44-a034-1621065e87ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037647 Aug 07 10:54:40.987913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 33/55] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:41.007751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:41.012721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:41.022127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:41.023017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:41.023670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:41.024595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:41.025476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:41.026171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:41.207534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:41.223591 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:41.226030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:41.229415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-98200296-0685-4945-939b-bc7e94f09873 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1286 microversion: 2.20 time: 0.227561 Aug 07 10:54:41.231546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 34/56] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:40 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1286 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:41.275977 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:41.276607 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:41.288017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:41.288732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:41.289389 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:41.290288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:41.290745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:41.291361 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:41.905640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:41.914163 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-21948e66-6d05-4f4e-b70e-1b6760b5f1f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.644969 Aug 07 10:54:41.914825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 35/57] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:41 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:41.994715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-262bd137-07c5-4fd3-8b48-f6cb30cb74df req-467af7a2-e7ab-4a81-8150-de979eda773d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685facdf-09b2-422e-910a-4f139dbd14ca", "tag": "1363236b-856c-4b92-8ec6-73e370811703"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:42.011793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-262bd137-07c5-4fd3-8b48-f6cb30cb74df req-467af7a2-e7ab-4a81-8150-de979eda773d service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.012660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-262bd137-07c5-4fd3-8b48-f6cb30cb74df req-467af7a2-e7ab-4a81-8150-de979eda773d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.013418 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-262bd137-07c5-4fd3-8b48-f6cb30cb74df req-467af7a2-e7ab-4a81-8150-de979eda773d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.025654 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-262bd137-07c5-4fd3-8b48-f6cb30cb74df req-467af7a2-e7ab-4a81-8150-de979eda773d service nova] Creating event network-changed:1363236b-856c-4b92-8ec6-73e370811703 for instance 685facdf-09b2-422e-910a-4f139dbd14ca on hv-cinder-85032 Aug 07 10:54:42.030486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-262bd137-07c5-4fd3-8b48-f6cb30cb74df req-467af7a2-e7ab-4a81-8150-de979eda773d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114544 Aug 07 10:54:42.031791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 36/58] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:42.039577 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:42.040737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:42.047190 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.048038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.048815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.049921 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.050586 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.051241 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.184945 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:54:42.185978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:54:42.186628 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:54:42.187271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:54:42.187845 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:54:42.201220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.205574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.211807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.213331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.213926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.214955 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.247235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:54:42.258979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for user 2b64b05230b940eba992a063ea7cd778 and project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:54:42.271887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:54:42.274345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:54:42.333357 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c463ef3c-89f7-48cf-b157-9050a5983aee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.058587 Aug 07 10:54:42.334114 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 23/59] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:54:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:54:42.340110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:42.340944 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:42.348197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.351264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.351835 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.352656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.353221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.353771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.398521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:42.408232 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7105f83b-52b9-46ac-b8ef-5ab1c90e3a76 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.374281 Aug 07 10:54:42.409016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 37/60] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:42 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:42.414856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-35bbd546-6620-4711-86b7-d400920bfc4a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:42.416129 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-35bbd546-6620-4711-86b7-d400920bfc4a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:42.448115 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:42.459776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:42.465207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:42.466606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2f1144c-be1a-4c52-95f7-35999cbcb858 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1334 microversion: 2.20 time: 0.131358 Aug 07 10:54:42.467352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 24/61] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:42 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1334 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:42.509249 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35bbd546-6620-4711-86b7-d400920bfc4a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:42.521675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-35bbd546-6620-4711-86b7-d400920bfc4a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1236 microversion: 2.1 time: 0.111171 Aug 07 10:54:42.525136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 38/62] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:42 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1236 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:42.935196 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:42.935848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:42.942517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.943044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.943509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:42.944191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:42.944657 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:42.945089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:43.101732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:43.109537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-345a5cf1-9296-4e87-b62a-bf3b1467acc8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.178610 Aug 07 10:54:43.110163 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 25/63] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:42 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:43.433064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:43.435735 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:43.454550 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:43.455120 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:43.455562 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:43.456569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:43.457127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:43.457551 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:43.494168 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:43.495531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:43.503083 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:43.503804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:43.504236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:43.504947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:43.505434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:43.505829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:43.598206 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:43.606226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:43.608733 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:43.610633 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-34301867-b307-4654-b473-13941692dc10 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1334 microversion: 2.20 time: 0.122559 Aug 07 10:54:43.621453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 26/64] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:43 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:43.621453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:43.621453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:43.623736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:43.624425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:43.625139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:43.626008 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:43.626568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:43.627648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:43.726620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:43.739618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-87e413e6-606b-4981-b9be-082d90aed918 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1240 microversion: 2.1 time: 0.124038 Aug 07 10:54:43.740235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 27/65] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:43 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:43.758347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:43.767574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-09f02df6-75f8-4459-b0d1-4285b92bf750 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.342060 Aug 07 10:54:43.768159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 39/66] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:43 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:44.130141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:44.130847 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:44.138349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.139113 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.139711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:44.140592 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.141882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.142468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:44.311363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:44.319809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-80740138-9754-4c2a-bf44-bd9f6e8589d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.193446 Aug 07 10:54:44.332991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 28/67] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:44 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:44.634373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:44.635016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:44.636960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:44.644340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.644998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.645429 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:44.646121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.646605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.647072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:44.652058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=91 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:44.761306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:44.761921 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:44.768262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.768747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.769303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:44.770193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.770644 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.771110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:44.898239 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:44.899040 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:44.914194 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:44.914444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4fe175fd-a4a0-4813-988e-6f1dc19c018f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1240 microversion: 2.1 time: 0.156968 Aug 07 10:54:44.915735 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:44.917453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-47036508-5f55-4fce-847e-3698b9151189 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1334 microversion: 2.20 time: 0.287866 Aug 07 10:54:44.918011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 40/68] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:44 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1334 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:44.922503 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:44.923199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:44.927587 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 29/69] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:44 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1240 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:44.940800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.941304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.941742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:44.943327 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:44.943972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:44.944407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:45.230358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:45.257495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-256a0cf9-84c2-4da9-95a3-e28b4672865d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.334913 Aug 07 10:54:45.258306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 41/70] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:44 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:45.340547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:45.341169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:45.343025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=9 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:45.368262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:45.368851 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:45.369616 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:45.370427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:45.370897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:45.371440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:45.544897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:45.554809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-afe125cc-98b9-486e-87aa-e32b774c112d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.218179 Aug 07 10:54:45.555412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 30/71] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:45 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:45.942000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:45.943382 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:45.952028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:45.952762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:45.953272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:45.954087 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:45.954193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:45.955203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:45.955889 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:45.956465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:45.969125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:45.978143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:45.979991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:45.982734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:45.984617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:45.987271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:46.060672 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:46.077589 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:46.082393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:46.084358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7f31819e-b99d-4efe-b2dc-38bed24f975b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1334 microversion: 2.20 time: 0.146638 Aug 07 10:54:46.100004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 42/72] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:45 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:46.114339 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:46.122713 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e7c51f9a-18a3-4173-9d58-9875338922e1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1232 microversion: 2.1 time: 0.174309 Aug 07 10:54:46.131334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 31/73] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:45 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1232 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:46.280127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:46.280760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:46.289796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:46.290297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:46.290820 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:46.291725 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:46.292743 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:46.293684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:46.537593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:46.546614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f7cb0534-d891-4619-8184-4869cd11f474 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.271184 Aug 07 10:54:46.547774 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 43/74] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:46 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:46.577166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:46.577877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:46.585379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:46.585983 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:46.586646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:46.587850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:46.588346 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:46.588985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:46.839446 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:46.849361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b9f59451-9427-4271-b85e-814806d5972c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.276994 Aug 07 10:54:46.862965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 32/75] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:46 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:47.108308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:47.109035 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:47.116885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.117641 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.118305 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.119637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.120372 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.120867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.147569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:47.148808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:47.158108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.159110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.159954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.161375 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.162271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.162948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.182794 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:47.234390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:47.250882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:47.260236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:47.264314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6d209b23-1459-409f-b7da-08ea86fc2740 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1334 microversion: 2.20 time: 0.160744 Aug 07 10:54:47.265125 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 44/76] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:47 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:47.321430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:47.332967 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e591f5ee-def4-477e-9b48-ea7f43de574c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1232 microversion: 2.1 time: 0.191344 Aug 07 10:54:47.335440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 33/77] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:47 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1232 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:47.572217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:47.572907 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:47.592322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.592832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.595990 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.599046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.599548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.601523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.871328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:47.871948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:47.883160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.888761 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.889618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.890815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:47.892084 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:47.892738 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:47.906776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:47.918151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-15e7c044-c33b-473e-afb1-5a8934534d54 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.353642 Aug 07 10:54:47.933841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 45/78] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:47 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:48.076340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:48.085022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4c79cf16-479b-457b-aaab-4136e27e1fb1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.217568 Aug 07 10:54:48.085764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 34/79] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:47 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:48.289129 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:48.289744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:48.297872 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:48.298516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:48.299089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:48.300180 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:48.300637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:48.301295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:48.363404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:48.364566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:48.374156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:48.374944 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:48.376032 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:48.377206 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:48.381004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:48.383494 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:48.384793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:48.385239 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:48.385690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:48.387106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2dfc06b5-b3fd-4eb6-b8bf-39cf9d7055d0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1342 microversion: 2.20 time: 0.102130 Aug 07 10:54:48.388170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 46/80] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:48 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:48.507405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:48.520281 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-89ca79f1-0370-4466-9d94-5622e97dd7dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1288 microversion: 2.1 time: 0.165995 Aug 07 10:54:48.523533 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 35/81] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:48 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1288 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:48.942539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:48.943334 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:48.952102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:48.952599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:48.953040 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:48.953970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:48.954804 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:48.955627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:49.111955 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:49.113213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:49.125547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:49.126371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:49.127524 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:49.129089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:49.130434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:49.130949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:49.278101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:49.293302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-98ef5e59-0306-4762-8d2c-740fed575b2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.356750 Aug 07 10:54:49.297897 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 47/82] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:48 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:49.396235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:49.413604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:49.416542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:49.423901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0b0550c2-00a4-4a7c-b54a-025b520519bf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.310279 Aug 07 10:54:49.425305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 36/83] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:49 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:49.440922 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:49.442748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:49.443631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:49.445253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:49.447221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:49.448646 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:49.545978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:49.546764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:49.558775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:49.559735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:49.564555 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:49.567299 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:49.569070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:49.571237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:49.766220 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:49.781310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:49.783717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:49.784862 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7600f18e-5d6f-4d0b-9177-df0a16812523 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1342 microversion: 2.20 time: 0.375849 Aug 07 10:54:49.801193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 48/84] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:49 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1342 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:49.940066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:49.970134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9593cb00-1b64-4238-b136-8a7ba25987ae tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1288 microversion: 2.1 time: 0.430087 Aug 07 10:54:49.974415 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 37/85] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:49 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1288 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:50.229378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-575970f6-9b57-4ec5-a496-cfb9be0b8135 req-116ff6da-f7b9-4724-8712-835d882ef322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e465ec9d-f167-4410-b5dd-95c885e888a4", "name": "network-vif-plugged", "status": "completed", "tag": "fe5bcaad-6e9a-4fc9-a938-a0811d665192"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:50.242487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-575970f6-9b57-4ec5-a496-cfb9be0b8135 req-116ff6da-f7b9-4724-8712-835d882ef322 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:50.243444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-575970f6-9b57-4ec5-a496-cfb9be0b8135 req-116ff6da-f7b9-4724-8712-835d882ef322 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:50.244231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-575970f6-9b57-4ec5-a496-cfb9be0b8135 req-116ff6da-f7b9-4724-8712-835d882ef322 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:50.272718 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-575970f6-9b57-4ec5-a496-cfb9be0b8135 req-116ff6da-f7b9-4724-8712-835d882ef322 service nova] Creating event network-vif-plugged:fe5bcaad-6e9a-4fc9-a938-a0811d665192 for instance e465ec9d-f167-4410-b5dd-95c885e888a4 on hv-cinder-85032 Aug 07 10:54:50.296384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-575970f6-9b57-4ec5-a496-cfb9be0b8135 req-116ff6da-f7b9-4724-8712-835d882ef322 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338569 Aug 07 10:54:50.304845 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 49/86] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:54:50.320172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:50.322745 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:50.335963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:50.337404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:50.339196 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:50.340038 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:50.341650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:50.343211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:50.447472 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:50.448238 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:50.457385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:50.457880 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:50.460004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:50.461081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:50.463304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:50.467779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:51.087906 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:51.110791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d3645ebc-78c3-4f2b-8da1-f33e087ae0dc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.666630 Aug 07 10:54:51.112949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 50/87] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:50 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:51.124204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:51.126314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:51.138810 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:51.140314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:51.144235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:51.145662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:51.147027 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:51.150654 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:51.243235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:51.259647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-37168d1f-1131-44dc-855e-eee0abe1bdc6 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.944821 Aug 07 10:54:51.260238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 38/88] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:50 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:51.279662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:51.280538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:51.287254 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:51.288022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:51.288605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:51.289532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:51.290426 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:51.291122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:51.325000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:51.418287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:51.431614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:51.444544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:51.485973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-062a7c47-38f5-416a-8bfb-d2f28752aca5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1340 microversion: 2.20 time: 0.331563 Aug 07 10:54:51.487122 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 51/89] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:51 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1340 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:51.505360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:51.520389 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2f09dc1-794b-417a-b978-99e740f80c96 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1294 microversion: 2.1 time: 0.245056 Aug 07 10:54:51.533981 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 39/90] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:51 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1294 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:52.134710 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:52.135690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:52.144151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.145198 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.145850 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.146561 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.147683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.148409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.280488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:52.281101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:52.283133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:52.284413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=18 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:52.291704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.292412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.293011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.293865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.294487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.295122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.521677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=24 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:52.737449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:52.751379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d177e9e9-b592-4a65-bad9-d12639786748 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.620786 Aug 07 10:54:52.753225 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 52/91] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:52 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:52.779572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-d33bee36-8842-46c2-9258-654f8473df02 req-59c55961-9b8b-4ede-84b3-0e83c47a5a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f67c015-509d-42e7-b1fb-0b70bdafefa9", "name": "network-vif-plugged", "status": "completed", "tag": "0a235f8a-de93-40e4-8382-67cb77a1c7e4"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:52.791659 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:52.803621 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a693226-998c-47e6-964b-e76af85def56 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.526706 Aug 07 10:54:52.814958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 40/92] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:52 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:52.815297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d33bee36-8842-46c2-9258-654f8473df02 req-59c55961-9b8b-4ede-84b3-0e83c47a5a38 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.815297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d33bee36-8842-46c2-9258-654f8473df02 req-59c55961-9b8b-4ede-84b3-0e83c47a5a38 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.815297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d33bee36-8842-46c2-9258-654f8473df02 req-59c55961-9b8b-4ede-84b3-0e83c47a5a38 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.823633 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:52.824693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:52.832785 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.834875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.837146 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.838249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.839035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.839716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.843502 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-d33bee36-8842-46c2-9258-654f8473df02 req-59c55961-9b8b-4ede-84b3-0e83c47a5a38 service nova] Creating event network-vif-plugged:0a235f8a-de93-40e4-8382-67cb77a1c7e4 for instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 on hv-cinder-85032 Aug 07 10:54:52.859539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-d33bee36-8842-46c2-9258-654f8473df02 req-59c55961-9b8b-4ede-84b3-0e83c47a5a38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099082 Aug 07 10:54:52.861171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 53/93] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:52.886096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:52.886828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:52.928272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.929053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.932927 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:52.939947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:52.942508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:52.943013 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:53.575527 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:53.589290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:53.592464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:53.596408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-028ff43c-189b-4151-a20e-1a5f0ba1ac1c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.786484 Aug 07 10:54:53.599814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 41/94] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:52 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:53.617134 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:53.629540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f21d4976-8f79-4645-b406-17a17bb89575 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.762126 Aug 07 10:54:53.630616 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 54/95] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:52 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:53.778141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:53.778773 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:53.790181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:53.795489 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:53.799951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:53.800582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:53.801198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:53.801475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:53.827221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:53.828229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:53.836765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:53.837267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:53.837706 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:53.838410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:53.838867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:53.855559 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:54.600453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:54.622374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:54.649658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c8993d18-851e-4988-a49e-add249c18dfc tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.875753 Aug 07 10:54:54.652558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3a88dfa1-f8e2-4ee9-9227-4dad4b2e35fa tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.818744 Aug 07 10:54:54.653225 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 55/96] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:53 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:54.656188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 42/97] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:53 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:54.661867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:54.662467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:54.672523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-8fa0f896-45ce-4d4c-8661-b6d9d6b7171c req-2237f8cb-0a3b-40b0-8083-15473e457519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ec2284-c34f-4e70-b19f-4e762542600e", "tag": "90ed1281-54b7-4284-9826-dc980d8a465a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:54.674143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:54.674678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:54.675177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:54.675875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:54.676811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:54.677386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:54.695487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8fa0f896-45ce-4d4c-8661-b6d9d6b7171c req-2237f8cb-0a3b-40b0-8083-15473e457519 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:54.695968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8fa0f896-45ce-4d4c-8661-b6d9d6b7171c req-2237f8cb-0a3b-40b0-8083-15473e457519 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:54.697082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8fa0f896-45ce-4d4c-8661-b6d9d6b7171c req-2237f8cb-0a3b-40b0-8083-15473e457519 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:54.725874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-8fa0f896-45ce-4d4c-8661-b6d9d6b7171c req-2237f8cb-0a3b-40b0-8083-15473e457519 service nova] Creating event network-changed:90ed1281-54b7-4284-9826-dc980d8a465a for instance 72ec2284-c34f-4e70-b19f-4e762542600e on hv-cinder-85032 Aug 07 10:54:54.737101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-8fa0f896-45ce-4d4c-8661-b6d9d6b7171c req-2237f8cb-0a3b-40b0-8083-15473e457519 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068252 Aug 07 10:54:54.738867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 56/98] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:54.753727 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:54.756179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:54.771162 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:54.772235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:54.772999 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:54.774016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:54.774677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:54.775465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:55.135645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:55.146493 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-213acddc-7a26-4d5f-a3db-fbb16358e3d8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.397963 Aug 07 10:54:55.148368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 57/99] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:54 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:55.166353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:55.177574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:55.179984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:55.181156 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-029c1d2e-8e44-4f1b-a1c2-70b0590f287b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.523901 Aug 07 10:54:55.181726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 43/100] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:54 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:55.250745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-1f1f743e-d8c5-478a-83d1-cf3251f43afa req-f6cdfc6f-40db-48eb-bd8e-21a21cfe1260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad22310-bbff-4a4d-b3e1-08f2f0ee19bb", "tag": "7241f531-f113-4b1c-85e1-d78a8ccecdf7"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:55.264169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1f1f743e-d8c5-478a-83d1-cf3251f43afa req-f6cdfc6f-40db-48eb-bd8e-21a21cfe1260 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:55.264968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1f1f743e-d8c5-478a-83d1-cf3251f43afa req-f6cdfc6f-40db-48eb-bd8e-21a21cfe1260 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:55.265589 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1f1f743e-d8c5-478a-83d1-cf3251f43afa req-f6cdfc6f-40db-48eb-bd8e-21a21cfe1260 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:55.282459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-1f1f743e-d8c5-478a-83d1-cf3251f43afa req-f6cdfc6f-40db-48eb-bd8e-21a21cfe1260 service nova] Creating event network-changed:7241f531-f113-4b1c-85e1-d78a8ccecdf7 for instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb on hv-cinder-85032 Aug 07 10:54:55.288484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-1f1f743e-d8c5-478a-83d1-cf3251f43afa req-f6cdfc6f-40db-48eb-bd8e-21a21cfe1260 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044825 Aug 07 10:54:55.289406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 58/101] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:55.673233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:55.674353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:55.680904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:55.681513 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:55.681985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:55.681985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:55.682609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:55.682860 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:55.683411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:55.683974 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:55.693346 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:55.694029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:55.694906 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:55.696041 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:55.696877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:55.698014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:55.718169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:55.942568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:55.955317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6225624c-ab86-4270-b39c-3c494496bab0 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.285849 Aug 07 10:54:55.956235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 44/102] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:55 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:55.982741 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-46a1c66a-b401-4787-964a-a10a7e7a6078 req-dac4af7f-1c57-4fb7-9dbd-6b48c16434d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685facdf-09b2-422e-910a-4f139dbd14ca", "name": "network-vif-plugged", "status": "completed", "tag": "1363236b-856c-4b92-8ec6-73e370811703"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:55.998895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:56.002784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-46a1c66a-b401-4787-964a-a10a7e7a6078 req-dac4af7f-1c57-4fb7-9dbd-6b48c16434d7 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:56.003406 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-46a1c66a-b401-4787-964a-a10a7e7a6078 req-dac4af7f-1c57-4fb7-9dbd-6b48c16434d7 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:56.003942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-46a1c66a-b401-4787-964a-a10a7e7a6078 req-dac4af7f-1c57-4fb7-9dbd-6b48c16434d7 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:56.009444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1ded41db-f507-49fe-b5ee-207236fabb11 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1321 microversion: 2.1 time: 0.336703 Aug 07 10:54:56.010163 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 59/103] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:55 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:56.035257 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-46a1c66a-b401-4787-964a-a10a7e7a6078 req-dac4af7f-1c57-4fb7-9dbd-6b48c16434d7 service nova] Creating event network-vif-plugged:1363236b-856c-4b92-8ec6-73e370811703 for instance 685facdf-09b2-422e-910a-4f139dbd14ca on hv-cinder-85032 Aug 07 10:54:56.035783 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-46a1c66a-b401-4787-964a-a10a7e7a6078 req-dac4af7f-1c57-4fb7-9dbd-6b48c16434d7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 10:54:56.036184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-46a1c66a-b401-4787-964a-a10a7e7a6078 req-dac4af7f-1c57-4fb7-9dbd-6b48c16434d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 10:54:56.037206 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:56.037819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:56.038258 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:56.038999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:56.039461 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:56.039885 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:56.049544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.compute.rpcapi [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 10:54:56.050408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] Releasing lock "compute-rpcapi-router" {{(pid=117615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 10:54:56.069170 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a11275c6-3a8b-4303-8880-e00bd6738544 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104393 Aug 07 10:54:56.070079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 45/104] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:54:56.170213 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:56.170986 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:56.178978 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:56.180229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:56.181012 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:56.182001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:56.182742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:56.183450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:56.204750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:56.205915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:56.212762 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:56.213537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:56.214215 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:56.215058 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:56.215864 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:56.216480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:56.502984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:56.517062 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:56.521265 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:56.525648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f2f7c0ec-699f-42eb-aede-bd1d186a17e4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.325636 Aug 07 10:54:56.528559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 46/105] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:56 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:54:56.564484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:56.591846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-31125e58-2e12-4477-86f5-cb43aa4fcedf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.424800 Aug 07 10:54:56.594368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 60/106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:56 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:56.996379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:56.998171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:57.019187 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.020104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.020784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.021637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.022418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.023184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.031062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:57.032703 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:57.046406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.048797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.051363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.052294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.055900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.059424 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.462643 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:57.488052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:57.501404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8beee44d-8529-472d-9558-b0117f1fb2de tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.524457 Aug 07 10:54:57.504550 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 47/107] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:56 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:57.535495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ca740117-ca87-433d-b0bf-ef5bf0d531a4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1514 microversion: 2.1 time: 0.501197 Aug 07 10:54:57.539008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 61/108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:57 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1514 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:57.568203 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:57.569108 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:54:57.569263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:57.571988 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:57.585292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.585951 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.586557 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.588853 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.589488 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.590785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.614279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.616566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.617683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.619697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.621642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.622796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.725572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lazy-loading 'flavor' on Instance uuid 6f67c015-509d-42e7-b1fb-0b70bdafefa9 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:54:57.802017 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:57.811029 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:57.813128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:57.814505 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-77945f84-43bd-4850-a97c-c97579ebb788 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.251698 Aug 07 10:54:57.815514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 48/109] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:57 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:54:57.820544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:57.821301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:57.827519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.828467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.829123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.830144 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.830635 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.831158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.859171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e240806a-4f11-42ca-bd0d-ac1e924e7f82 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9/action" status: 200 len: 32 microversion: 2.1 time: 0.296036 Aug 07 10:54:57.860031 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 62/110] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:54:57 2022] POST /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 10:54:57.869945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:57.871117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:57.877836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.878324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.878765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:57.879515 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:57.879974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:57.880640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:58.036629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:58.052095 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d3e2e106-ff67-4006-9aac-c3cabdd6842a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.235245 Aug 07 10:54:58.052669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 49/111] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:57 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:58.077633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:58.085623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5458908e-b1c3-46c8-bf48-5f0c8b06d408 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.219818 Aug 07 10:54:58.086196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 63/112] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:57 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:58.524878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:58.525424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:58.533253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:58.533917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:58.534872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:58.535702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:58.536796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:58.537343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:58.718129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:58.728189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-228c1a24-ef9f-42c2-a98d-33830a86897a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.208322 Aug 07 10:54:58.738971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 50/113] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:58 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:54:58.837147 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:58.837829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:58.845311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:58.846014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:58.846776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:58.847883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:58.848421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:58.848915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:59.015011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:59.023598 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:59.025097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:59.026259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fe928737-028d-4052-a3e3-b89e607eb8ff tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.193192 Aug 07 10:54:59.026824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 64/114] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:54:58 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:54:59.073184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:59.073976 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:59.080177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:59.080753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:59.081086 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:59.081777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:59.082232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:59.082649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:59.111299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:59.111299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:59.133470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:59.135766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:59.136291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:59.137124 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:59.137673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:59.138168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:59.292437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:59.300532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35eb0b18-9450-45dc-96c7-df8877d586b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.231055 Aug 07 10:54:59.301105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 51/115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:59 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:59.329432 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:59.337169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-405b3fdf-0b14-4e06-a322-ae86005d9beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.233431 Aug 07 10:54:59.337895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 65/116] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:59 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:54:59.752104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:54:59.753556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:54:59.785331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:59.785725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:59.786323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:59.787202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:54:59.787655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:54:59.788073 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:54:59.938552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:54:59.947987 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4bcdab05-3e63-4820-b063-35d86584bd8e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.202106 Aug 07 10:54:59.948648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 52/117] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:54:59 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:00.049061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:00.049912 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:00.056039 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.056520 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.056953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:00.057642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.058097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.058711 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:00.216649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:00.227373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:00.229536 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:00.230852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4f3782c3-76ae-416d-8fea-0c11da0e19c2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.186308 Aug 07 10:55:00.231662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 66/118] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:00 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:00.322147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:00.323387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:00.329475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.329975 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.330438 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:00.331231 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.331684 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.332197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:00.358551 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:00.359197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:00.365972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.366463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.366932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:00.367625 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.368085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.368507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:00.565456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:00.572829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-276a69a7-ed34-4726-bc7c-08074352555e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.254531 Aug 07 10:55:00.573400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 53/119] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:00 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:00.599196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:00.606776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fd1bf503-76d1-4879-b93f-e8b1c694caf7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.253008 Aug 07 10:55:00.607379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 67/120] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:00 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:00.969752 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:00.970401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:00.977749 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.977749 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.977749 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:00.977986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:00.978404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:00.978830 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:01.115815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:01.123923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-62012c46-0138-4bfc-b492-57494d933732 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.158772 Aug 07 10:55:01.124485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 54/121] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:00 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:01.253836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:01.254457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:01.260338 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:01.260829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:01.261264 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:01.261954 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:01.262408 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:01.262830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:01.405941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:01.414798 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:01.416534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:01.418271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-40c2fcf7-631f-4e0a-8b0b-ce59bdf31af6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.168329 Aug 07 10:55:01.418824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 68/122] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:01 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:01.595701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:01.596343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:01.603268 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:01.603741 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:01.604173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:01.605259 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:01.605919 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:01.606440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:01.629806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:01.630544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:01.638603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:01.639455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:01.640017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:01.640952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:01.641505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:01.642298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:01.843025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:01.849505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:01.857636 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ee20a82d-bcab-4727-a6bc-8d125a219de9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.233320 Aug 07 10:55:01.858484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 69/123] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:01 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:01.873759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1739d54c-90de-484f-99c6-c38b2baa14c1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.283389 Aug 07 10:55:01.879430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 55/124] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:01 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:02.146457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:02.147094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:02.153835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.154316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.155052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:02.155699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.156929 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.157667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:02.302191 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:02.310347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-533af5ea-264e-4df1-93cb-c5e8a8a63ec1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.169671 Aug 07 10:55:02.310942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 70/125] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:02 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:02.441273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:02.441889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:02.447936 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.448427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.448870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:02.449566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.450065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.450437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:02.469261 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:02.584507 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:02.593108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:02.594646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:02.595867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dc752cbc-ffea-433a-b911-191c487f6623 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.159206 Aug 07 10:55:02.596430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 56/126] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:02 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:02.878387 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:02.879099 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:02.885194 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.885673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.886096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:02.886782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.887260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.887674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:02.895380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:02.896325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:02.904687 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.905433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.906163 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:02.907358 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:02.908049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:02.909022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:03.275678 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:03.285725 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ae941891-53ed-41b3-912f-05ff5d3dc07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.412017 Aug 07 10:55:03.286849 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 71/127] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:02 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:03.302611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:03.311319 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7152d12-4807-4f55-afa8-c42d93c7f7b3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.420167 Aug 07 10:55:03.311897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 57/128] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:02 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:03.332211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:03.333336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:03.339213 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:03.339704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:03.340138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:03.341000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:03.341457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:03.341884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:03.486362 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:03.494088 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5d2beecf-eaa7-42e3-90a2-13472d5a9ca8 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.166876 Aug 07 10:55:03.494665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 72/129] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:03 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:03.619736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:03.620354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:03.626479 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:03.626995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:03.627434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:03.628127 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:03.628584 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:03.629012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:03.790508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:03.801512 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:03.803054 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:03.804239 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b89b70ed-7ea3-49ad-92f9-9535886b1250 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.188362 Aug 07 10:55:03.804992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 58/130] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:03 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:04.306542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:04.307194 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:04.313569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.314274 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.314484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:04.315204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.315664 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.316090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:04.333522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:04.334339 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:04.341425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.342210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.342773 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:04.344275 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.344937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.345434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:04.554060 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:04.561712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6dd10002-a22f-4ade-9487-a41c88fd8f53 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.258979 Aug 07 10:55:04.562970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 73/131] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:04 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:04.569133 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:04.569296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:04.575553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.576037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.576469 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:04.577159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.577618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.578623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:04.582230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:04.583536 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:04.592807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6184865b-e1d8-4a21-a7bf-a18f31042170 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.263249 Aug 07 10:55:04.601792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 59/132] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:04 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:04.777421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:04.784851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3d185578-4384-4ebf-a223-4546a40ba7df tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.220930 Aug 07 10:55:04.785488 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 74/133] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:04 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:04.827797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:04.829148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:04.835411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.835891 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.836352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:04.837037 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:04.837487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:04.837985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:05.011847 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:05.021185 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:05.022830 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:05.023982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-40a42ca8-1490-457a-9e61-3eb46ac2071c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.200159 Aug 07 10:55:05.024543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 60/134] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:04 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:05.586853 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:05.588129 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:05.602084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:05.603693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:05.604496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:05.606179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:05.606949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:05.607563 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:05.617168 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:05.617933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:05.628322 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:05.630362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:05.633269 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:05.635557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:05.636636 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:05.637083 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:06.047311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:06.086567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:06.098757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1fd2c6db-617e-4c65-8459-9c26c279ccec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.517185 Aug 07 10:55:06.100896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 75/135] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:05 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:06.107315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:06.108500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:06.116779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:06.117572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:06.118196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:06.119373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:06.120024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:06.120730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:06.157632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:06.167295 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2ff0b361-9c0d-4ed6-920e-5211b5229b59 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.555583 Aug 07 10:55:06.181524 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 61/136] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:05 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:06.186848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:06.187856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:06.195349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:06.196149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:06.196793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:06.197711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:06.198401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:06.199081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:06.542964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:06.552225 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d52b8ef3-61d0-42a5-8fe8-322db196bc3a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.449492 Aug 07 10:55:06.552891 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:06.553065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 76/137] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:06 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:06.571927 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:06.573465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:06.574590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-538ee21d-d477-4bf6-8966-09232d4239bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.391675 Aug 07 10:55:06.575191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 62/138] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:06 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:07.129929 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:07.131136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:07.137616 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.138445 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.139127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:07.140076 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.140761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.141244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:07.188690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:07.189373 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:07.195678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.196157 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.196790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:07.197479 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.197931 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.198350 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:07.684110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:07.688174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:07.693110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-32e22eb0-2115-48c8-8cb4-f49e6e625730 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.508273 Aug 07 10:55:07.695152 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 63/139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:07 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:07.695809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-12379fee-ab10-448b-8f7f-17b4b6d30b7a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.569597 Aug 07 10:55:07.708858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 77/140] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:07 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:07.709399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:07.710048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:07.713608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:07.714219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:07.717170 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.717917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.718350 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:07.719617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.720228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.720651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:07.726068 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.726560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.727031 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:07.727736 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:07.728189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:07.728613 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:08.026539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:08.030268 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:08.040220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ef393f53-71a3-4dcc-b284-37e4eff54d2b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.343273 Aug 07 10:55:08.040483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:08.041315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 64/141] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:07 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:08.041908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:08.043131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-647af8d5-1036-4a58-a95a-c7fb7044c404 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.333236 Aug 07 10:55:08.049881 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 78/142] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:07 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:08.714215 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:08.715551 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:08.719640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:08.721213 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:08.724740 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:08.725244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:08.725685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:08.726394 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:08.726855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:08.727366 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:08.731011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:08.734653 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:08.735566 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:08.736504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:08.738075 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:08.739968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:08.948198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:08.968617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c42f77a2-0337-4ee3-a17b-e93925a36c31 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.258204 Aug 07 10:55:08.969220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 65/143] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:08 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:08.994243 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:09.004755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-70ee3020-c033-4005-8cde-ddcef70d07c1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.292224 Aug 07 10:55:09.005942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 79/144] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:08 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:09.066094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:09.066705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:09.068351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:09.068965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:09.080371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:09.080865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:09.081310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:09.082069 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:09.082526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:09.082905 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:09.084349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:09.085029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:09.085436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:09.086178 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:09.086664 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:09.087106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:09.341202 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:09.344578 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:09.359723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-66aacda4-8306-49d6-99b6-d6311ec9ce5f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.301974 Aug 07 10:55:09.361815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 66/145] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:09 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:09.362017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:09.363768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:09.364926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-072eb12e-afb2-40e9-8728-9b1ce1bd65e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.303479 Aug 07 10:55:09.365620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 80/146] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:09 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:09.989767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:09.990915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:09.996998 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:09.997492 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:09.997961 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:09.999182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:09.999679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:10.000108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:10.025605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:10.026391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:10.033777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:10.034510 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:10.035134 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:10.036332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:10.036826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:10.037242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:10.235551 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:10.243418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5271b18-d5eb-465e-a2fd-8cd333e5c0dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.257415 Aug 07 10:55:10.243989 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 67/147] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:09 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:10.249204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:10.257073 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bfc73ba0-9093-41fc-bdf5-a063f2296e7c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.235269 Aug 07 10:55:10.257633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 81/148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:10 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:10.382592 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:10.383238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:10.389293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:10.389773 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:10.390821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:10.390944 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:10.391559 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:10.391838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:10.392298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:10.392722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:10.397970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:10.398448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:10.403277 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:10.404074 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:10.404549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:10.404981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:10.649437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:10.665179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5fe0062c-0da6-46b3-9031-189ff5b86204 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1314 microversion: 2.1 time: 0.286377 Aug 07 10:55:10.666417 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 68/149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:10 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:10.691111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:10.700330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:10.702009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:10.703493 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fbd400fa-6cf2-40c4-9b77-339ea3e7d197 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.318835 Aug 07 10:55:10.704284 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 82/150] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:10 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:11.264974 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:11.267291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:11.274567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.275543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.276211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:11.277134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.277767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.278438 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:11.279529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:11.280461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:11.294278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.294790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.295276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:11.296008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.302801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.305500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:11.565787 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:11.579125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7dcce920-c972-404d-badb-0083fca789c4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.318357 Aug 07 10:55:11.580256 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 69/151] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:11 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:11.580809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:11.592062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-28968416-c183-473f-9c7e-cd05639b7a27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.315116 Aug 07 10:55:11.593309 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 83/152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:11 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:11.688194 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:11.689275 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:11.696877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.711210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.712321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:11.713235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.714669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.715266 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:11.726746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:11.727632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:11.738065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.740648 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.741103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:11.741825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:11.742302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:11.747302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:12.047040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:12.064442 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-82042e33-d431-4ec1-bab3-fbf20ba12cce tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1500 microversion: 2.1 time: 0.380843 Aug 07 10:55:12.065048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 70/153] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:11 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1500 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:12.078866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-31f25fab-2700-487b-afda-801b37cf58a9 req-8fda129a-d30b-4d90-b571-128dfc436235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ec2284-c34f-4e70-b19f-4e762542600e", "name": "network-vif-plugged", "status": "completed", "tag": "90ed1281-54b7-4284-9826-dc980d8a465a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:12.092077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-31f25fab-2700-487b-afda-801b37cf58a9 req-8fda129a-d30b-4d90-b571-128dfc436235 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:12.094646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-31f25fab-2700-487b-afda-801b37cf58a9 req-8fda129a-d30b-4d90-b571-128dfc436235 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:12.100660 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-31f25fab-2700-487b-afda-801b37cf58a9 req-8fda129a-d30b-4d90-b571-128dfc436235 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:12.118300 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-31f25fab-2700-487b-afda-801b37cf58a9 req-8fda129a-d30b-4d90-b571-128dfc436235 service nova] Creating event network-vif-plugged:90ed1281-54b7-4284-9826-dc980d8a465a for instance 72ec2284-c34f-4e70-b19f-4e762542600e on hv-cinder-85032 Aug 07 10:55:12.130163 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:12.138578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:12.140572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:12.148524 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-31f25fab-2700-487b-afda-801b37cf58a9 req-8fda129a-d30b-4d90-b571-128dfc436235 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082256 Aug 07 10:55:12.149140 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 71/154] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:12.153064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d0791115-c989-4fe6-898c-e803c120f1e1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.431107 Aug 07 10:55:12.167443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 84/155] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:11 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:55:12.617600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:12.618574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:12.619139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:12.622363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:12.636353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:12.643594 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:12.644758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:12.645621 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:12.646965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:12.649999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:12.651211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:12.651419 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:12.651933 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:12.653035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:12.658855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:12.661717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:12.949769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:12.961347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-059d4a8c-1c90-4ef9-9ef6-86b1e652e427 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.347384 Aug 07 10:55:12.963214 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 85/156] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:12 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:12.977712 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:12.989345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4cd96069-5740-4003-91dc-b7fa7734bd40 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.387689 Aug 07 10:55:12.991279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 72/157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:12 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:13.178191 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:13.178804 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:13.186695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:13.188593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:13.189189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:13.190072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:13.191120 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:13.191556 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:13.384559 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:13.398051 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:13.400222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:13.401628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-18949ed1-4ec4-4f5b-9939-b5cdce61f1cb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.227030 Aug 07 10:55:13.402547 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 86/158] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:13 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:13.985324 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:13.986598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:13.992964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:13.994109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:13.994744 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:13.995729 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:13.996436 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:13.997206 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:14.014558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:14.015825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:14.028147 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:14.028866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:14.029447 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:14.032691 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:14.033377 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:14.033956 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:14.319994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:14.324740 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:14.338243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4bea33ff-9800-4136-b86b-69f62e8e7c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.356975 Aug 07 10:55:14.339727 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 73/159] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:13 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:14.370559 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:14.380495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5ce266a7-ab51-4edc-b9ba-79814db3d4b7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.372260 Aug 07 10:55:14.382080 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 87/160] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:14 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:14.434948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:14.435941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:14.444952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:14.445605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:14.446236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:14.447219 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:14.447822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:14.448391 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:14.757647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:14.773132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:14.776365 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:14.778949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3c7533fe-83da-44bc-98c8-b28524f93439 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.353838 Aug 07 10:55:14.780110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 74/161] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:14 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:14.830903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f1569a1-d03d-4cdf-ab69-ed91358185ac"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:14.835855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:14.850820 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=96 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:14.854289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:14.856441 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:14.859847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:14.860945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:14.861670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:14.862586 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:15.364147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:15.365401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:15.373865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:15.375597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:15.376129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:15.376850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:15.377535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:15.377968 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:15.627825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:15.638692 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6db81435-1e0a-4dd6-900e-c5e49a54fea6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.279421 Aug 07 10:55:15.640443 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 75/162] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:15 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:15.653793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:15.657643 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:15.676097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=92 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:15.678786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:15.679785 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:15.680537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:15.681541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:15.682133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:15.682694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:15.911674 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:15.926710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c5914940-ca52-456b-b6a5-4af83c3a1a22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.282952 Aug 07 10:55:15.928192 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 76/163] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:15 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:15.934584 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:15.935539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:15.943671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:15.944905 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:15.945609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:15.948452 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:15.949146 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:15.949723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:16.202017 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:16.211035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:16.212477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:16.219889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-90846993-9752-4dfe-b4ac-ec7a85b3a974 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.290419 Aug 07 10:55:16.220474 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 77/164] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:15 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:16.661534 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:16.662136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:16.668873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:16.669366 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:16.669839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:16.670548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:16.671025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:16.672972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:16.849137 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:16.862689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-60aa8144-d62a-4eff-94ba-0fe85b3b116c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.204738 Aug 07 10:55:16.863737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 78/165] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:16 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:16.948860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:16.949860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:16.961701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:16.962534 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:16.963247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:16.964147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:16.964806 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:16.965426 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:17.170047 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:17.183019 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-965acde9-766c-4d1c-a8fa-bca310f295c2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.237864 Aug 07 10:55:17.183691 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 79/166] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:16 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:17.243023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:17.243506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:17.254947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:17.255387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:17.255824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:17.256544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:17.256978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:17.257403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:17.414124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:17.433899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:17.435437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:17.436582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3d1a7de8-bef4-4a4d-8c17-330360c44231 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.197620 Aug 07 10:55:17.437988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 80/167] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:17 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:55:17.884398 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:17.885894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:17.897229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:17.897996 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:17.898607 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:17.899662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:17.900274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:17.900874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:18.050112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:18.059186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e20f238c-1f95-45d2-9978-5f6812c17604 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.178582 Aug 07 10:55:18.060034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 81/168] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:17 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:18.206873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:18.207519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:18.215960 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:18.220004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:18.220476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:18.221202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:18.221669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:18.222098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:18.644723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:18.655861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-20f57c0d-7454-4f9d-83f1-3572709aa5ee tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.454762 Aug 07 10:55:18.669208 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 82/169] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:18 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:18.683897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:18.684582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:18.694572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:18.695110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:18.695571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:18.696972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:18.696972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:18.697173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:18.861750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:18.873426 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:18.875925 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:18.879713 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26b6de52-c7eb-4017-9bda-42bb65e7eb16 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.209028 Aug 07 10:55:18.880507 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 83/170] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:18 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:19.081385 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:19.082820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:19.096667 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:19.097154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:19.097583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:19.098287 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:19.098738 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:19.099190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:19.364112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:19.372173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-56a31f6e-9df2-4b1e-909d-7777a268ffdb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.295394 Aug 07 10:55:19.386747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 84/171] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:19 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:19.684797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:19.685685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:19.693175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:19.693888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:19.694471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:19.695560 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:19.696216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:19.696999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:19.853908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:19.865154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-69513108-4de2-4d1d-b2d1-2190b0084eb5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.190528 Aug 07 10:55:19.866583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 85/172] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:19 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:19.902112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:19.903134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:19.914092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:19.914659 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:19.915275 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:19.916228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:19.917098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:19.917922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:20.136935 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:20.148213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:20.150072 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:20.152150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b6340b99-cb72-41fc-9f1a-7592e94959dd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.254237 Aug 07 10:55:20.157077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 86/173] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:19 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:20.394775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:20.407664 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:20.418866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:20.419618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:20.420204 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:20.421665 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:20.422365 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:20.423089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:20.661703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:20.672639 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-51d49500-785f-40c1-a139-64eb6eb16d30 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.282631 Aug 07 10:55:20.674565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 87/174] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:20 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:20.893304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:20.895187 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:20.911459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:20.918031 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:20.922728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:20.928097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:20.930376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:20.930376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:21.125741 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:21.134769 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bd067878-69cd-43e8-9f7c-40e87d5fe916 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.249015 Aug 07 10:55:21.147727 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 88/175] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:20 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:21.184610 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:21.185485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:21.193656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:21.194335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:21.196695 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:21.198343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:21.199017 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:21.199604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:21.400040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:21.408842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:21.411355 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:21.412709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ffe0cf60-f5bc-4c4c-b934-7b07669a3b89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.235235 Aug 07 10:55:21.413444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 89/176] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:21 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:55:21.694371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:21.695123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:21.709165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:21.711091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:21.712370 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:21.713301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:21.715614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:21.717092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:21.755917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:22.000389 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db983bf7-b874-45d5-8d94-ce63ed78082b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "POST /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.177275 Aug 07 10:55:22.000990 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 88/177] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:55:14 2022] POST /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca/os-volume_attachments => generated 194 bytes in 7179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:22.013364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:22.021697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e3d5b914-a189-4fe9-9572-0d4d9c0f2381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.331236 Aug 07 10:55:22.022273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 90/178] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:21 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:22.162272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:22.163181 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:22.170125 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:22.170764 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:22.171410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:22.172111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:22.172739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:22.173317 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:22.195336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:22.333884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:22.341355 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-026a9f13-f946-40c0-be5e-3201b0ce4025 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.187644 Aug 07 10:55:22.354458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 89/179] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:22 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:22.435572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:22.436901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:22.444487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:22.445210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:22.445648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:22.446341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:22.446792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:22.447236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:22.685277 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:22.701738 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:22.705119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:22.706427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-974eaae6-6a63-47b6-88ba-2e416a9f2434 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.274646 Aug 07 10:55:22.714979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 91/180] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:22 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:23.041743 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:23.042570 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:23.050628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:23.051463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:23.052119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:23.052818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:23.053435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:23.053864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:23.217195 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:23.225450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d652e369-ac1e-4cc9-a40d-00f79e1ec6e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.187699 Aug 07 10:55:23.226097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 90/181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:23 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:23.362072 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:23.362764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:23.373318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:23.373759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:23.374898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:23.375650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:23.376111 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:23.376539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:23.623272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:23.635999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ae50896d-ffa3-4449-8bdb-7fce251db24e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.278276 Aug 07 10:55:23.636579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 92/182] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:23 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:23.728458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:23.729083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:23.738336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:23.738814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:23.739282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:23.740001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:23.740455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:23.740875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:23.900964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:23.919965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:23.922726 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:23.924115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-985ad4ad-a9fb-4562-873e-8f8ccc7b288a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.199495 Aug 07 10:55:23.925427 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 91/183] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:23 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:55:24.247233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:24.248197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:24.257118 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:24.260178 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:24.260946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:24.263568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:24.264263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:24.267594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:24.588587 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:24.603995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-85df2fd8-d7eb-4e60-8be8-0bdb8914f44e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.360815 Aug 07 10:55:24.605623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 93/184] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:24 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:24.664034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:24.664633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:24.671140 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:24.671779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:24.672224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:24.673362 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:24.673976 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:24.674574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:24.900287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:24.914695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-53565317-0edc-48f9-93ee-02504424c9b4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.255421 Aug 07 10:55:24.915321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 92/185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:24 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:24.949792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:24.950558 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:24.957525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:24.965067 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:24.966991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:24.970217 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:24.971619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:24.972510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:25.205601 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:25.218596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:25.220638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:25.222100 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-77bde2fa-5603-4070-8446-b0ebd12b673a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1408 microversion: 2.20 time: 0.276748 Aug 07 10:55:25.223168 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 94/186] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:24 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:25.237923 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-59f3b715-3961-41ab-8bc0-d88faf1dc980 req-e0039f18-616d-499d-bcc1-d223fe294eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad22310-bbff-4a4d-b3e1-08f2f0ee19bb", "name": "network-vif-plugged", "status": "completed", "tag": "7241f531-f113-4b1c-85e1-d78a8ccecdf7"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:25.257184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-59f3b715-3961-41ab-8bc0-d88faf1dc980 req-e0039f18-616d-499d-bcc1-d223fe294eb8 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:25.257683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-59f3b715-3961-41ab-8bc0-d88faf1dc980 req-e0039f18-616d-499d-bcc1-d223fe294eb8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:25.258117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-59f3b715-3961-41ab-8bc0-d88faf1dc980 req-e0039f18-616d-499d-bcc1-d223fe294eb8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:25.281967 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-59f3b715-3961-41ab-8bc0-d88faf1dc980 req-e0039f18-616d-499d-bcc1-d223fe294eb8 service nova] Creating event network-vif-plugged:7241f531-f113-4b1c-85e1-d78a8ccecdf7 for instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb on hv-cinder-85032 Aug 07 10:55:25.288484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-59f3b715-3961-41ab-8bc0-d88faf1dc980 req-e0039f18-616d-499d-bcc1-d223fe294eb8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054565 Aug 07 10:55:25.289756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 93/187] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:25.626307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:25.626941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:25.639456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:25.641123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:25.641564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:25.642285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:25.642748 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:25.643214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:25.835709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:25.845323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3b73fd2a-da14-430e-a0b9-a26aaac7ecee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.223456 Aug 07 10:55:25.854950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 95/188] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:25 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:25.940692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:25.941388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:25.953665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:25.954421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:25.955596 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:25.956539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:25.957141 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:25.958216 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:26.134730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:26.143434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b735ffdc-5e7d-4fcb-b5cf-2c13b61384a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.209387 Aug 07 10:55:26.147363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 94/189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:25 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:26.250137 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:26.250756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:26.257578 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:26.258322 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:26.259021 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:26.259954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:26.260618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:26.261249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:26.454227 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:26.465652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:26.467185 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:26.468375 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9c7133d1-af27-4b4d-8bd2-451d694867ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1600 microversion: 2.20 time: 0.224583 Aug 07 10:55:26.474979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 96/190] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:55:26 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1600 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:55:26.493924 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:26.494414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:26.501595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:26.502082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:26.502511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:26.503920 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:26.504521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:26.505095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:26.622377 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-07d6fa14-174e-4ff6-845d-f65ce93d0cfd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.132261 Aug 07 10:55:26.623212 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 95/191] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Aug 7 10:55:26 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:55:26.886275 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:26.887096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:26.899585 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:26.904320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:26.906011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:26.910357 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:26.911073 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:26.911703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:27.168544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:27.169171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:27.178917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:27.179435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:27.185090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:27.187310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:27.187965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:27.190463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:27.235547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:27.247020 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e7f36cca-784e-4295-b661-1bbf75196be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.366347 Aug 07 10:55:27.247714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 97/192] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:26 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:27.443456 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:27.457607 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e852a1af-4308-4689-b0ad-eca8972f6716 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.292662 Aug 07 10:55:27.482175 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 96/193] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:27 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:28.123553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b2959664-8b7f-4d2d-a23f-523e8ab7e1f4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Action: 'create', calling method: .version_select at 0x7fc5ee53c670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-430952669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFslfKv3dig+TJuDS2KHqde7vtW1AF3Gf8FmMsDBhINfv1dKokkzQQMmIzMOPUw1AgEe2Dhre5ggzGK4OaLIqJTVhj2rSbZyHQG6LPsIzVcp2USuGURnw0meiS+dDb+6g=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:28.160317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b2959664-8b7f-4d2d-a23f-523e8ab7e1f4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Getting quotas for project 112b9a6f7ead454695e7efd26c0d845b. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:55:28.165499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b2959664-8b7f-4d2d-a23f-523e8ab7e1f4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Getting quotas for user ee9ca3b9c7284fd1a600cbd3add41f56 and project 112b9a6f7ead454695e7efd26c0d845b. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:55:28.240375 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b2959664-8b7f-4d2d-a23f-523e8ab7e1f4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.121118 Aug 07 10:55:28.241336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 98/194] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 10:55:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:28.284045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:28.284791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:28.294205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:28.294205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:28.294205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:28.297895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:28.298821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:28.299542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:28.406544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1220841994", "imageRef": "6b1b5bd7-a31c-4a29-ab4a-1dca6d1819bd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-430952669", "networks": [{"uuid": "43f8ddfc-2391-4984-b32a-39f38556a252"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:28.477277 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] validate_networks() for [('43f8ddfc-2391-4984-b32a-39f38556a252', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:55:28.489918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:28.500585 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ece7b245-c9cf-4a67-bca6-fe2954e361c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.222494 Aug 07 10:55:28.505458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 97/195] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:28 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:28.521736 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:28.522474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:28.529139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:28.529864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:28.530493 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:28.532157 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:28.533116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:28.534087 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:28.755435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:28.762882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e8c0576b-39ef-49f7-af05-0ff93cf4ae79 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.256105 Aug 07 10:55:28.763486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 98/196] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:28 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:28.768136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2a20765d-60eb-4d52-908e-d031498c4634 req-7542febe-d17f-4542-bd99-011982779abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ec2284-c34f-4e70-b19f-4e762542600e", "tag": "90ed1281-54b7-4284-9826-dc980d8a465a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:28.777983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a20765d-60eb-4d52-908e-d031498c4634 req-7542febe-d17f-4542-bd99-011982779abc service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:28.778681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a20765d-60eb-4d52-908e-d031498c4634 req-7542febe-d17f-4542-bd99-011982779abc service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:28.779149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a20765d-60eb-4d52-908e-d031498c4634 req-7542febe-d17f-4542-bd99-011982779abc service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:28.791098 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2a20765d-60eb-4d52-908e-d031498c4634 req-7542febe-d17f-4542-bd99-011982779abc service nova] Creating event network-changed:90ed1281-54b7-4284-9826-dc980d8a465a for instance 72ec2284-c34f-4e70-b19f-4e762542600e on hv-cinder-85032 Aug 07 10:55:28.797394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2a20765d-60eb-4d52-908e-d031498c4634 req-7542febe-d17f-4542-bd99-011982779abc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032632 Aug 07 10:55:28.798009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 99/197] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:29.017546 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:55:29.017973 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:55:29.018455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:55:29.018870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:55:29.019313 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:55:29.028085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:29.028577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:29.029015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:29.029742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:29.030763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:29.031216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:29.047946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Getting quotas for project 112b9a6f7ead454695e7efd26c0d845b. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:55:29.051949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Getting quotas for user ee9ca3b9c7284fd1a600cbd3add41f56 and project 112b9a6f7ead454695e7efd26c0d845b. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:55:29.063654 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:55:29.065844 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b1b5bd7-a31c-4a29-ab4a-1dca6d1819bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:55:29.129121 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07540309-6d1d-4458-a91e-979256ebb85a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727890 Aug 07 10:55:29.130898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 99/198] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:55:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:55:29.143583 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c493649a-96ed-445f-9b51-fef8f1765297 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:29.144903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c493649a-96ed-445f-9b51-fef8f1765297 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:29.202975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c493649a-96ed-445f-9b51-fef8f1765297 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:29.210379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c493649a-96ed-445f-9b51-fef8f1765297 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1258 microversion: 2.1 time: 0.071875 Aug 07 10:55:29.211289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 100/199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:29 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:29.524648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:29.525256 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:29.533943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:29.535055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:29.535789 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:29.537115 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:29.537115 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:29.537619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:29.688197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:29.696586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-37eefbb4-c44d-44d4-96e2-29b26fbe7f89 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.175667 Aug 07 10:55:29.709515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 100/200] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:29 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:29.788488 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:29.789354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:29.797354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:29.797844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:29.798283 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:29.799011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:29.799498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:29.799927 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:29.929415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:29.936812 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1c03e2e7-babb-4f50-beb8-6d731e8c3315 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.156570 Aug 07 10:55:29.937378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 101/201] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:29 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:30.230457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:30.231108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:30.237630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:30.238107 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:30.238540 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:30.239268 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:30.239726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:30.240143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:30.299319 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:30.306578 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9899134c-54c6-4d81-8707-6a993320ddcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1262 microversion: 2.1 time: 0.079913 Aug 07 10:55:30.307180 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 101/202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:30 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:30.717428 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:30.718527 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:30.724473 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:30.724948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:30.725374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:30.726052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:30.726498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:30.726913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:30.877885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:30.885823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-752a5b9b-8a02-4c4e-a82e-f4faa40f4561 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.172526 Aug 07 10:55:30.886395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 102/203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:30 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:30.957456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:30.958237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:30.964117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:30.964598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:30.965027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:30.965706 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:30.966155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:30.966573 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:31.149712 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:31.159824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-404fe58d-261a-4e79-a41c-635d04c9f2ec tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.206003 Aug 07 10:55:31.160818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 102/204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:30 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:31.330378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:31.331625 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:31.339484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:31.340340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:31.341032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:31.342001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:31.343412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:31.344059 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:31.436820 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:31.444101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3b02e852-256a-4ff4-b67a-8056771c1253 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1254 microversion: 2.1 time: 0.119676 Aug 07 10:55:31.444666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 103/205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:31 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1254 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:31.907999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:31.908602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:31.914414 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:31.914890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:31.915348 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:31.916024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:31.916475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:31.916899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:32.043364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:32.050792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0d30b0d2-3fc9-4573-9242-a15a2baf8574 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.147137 Aug 07 10:55:32.051390 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 103/206] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:31 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:32.182501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:32.183119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:32.189432 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:32.189909 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:32.190339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:32.191057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:32.191513 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:32.191936 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:32.324460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:32.332367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6868f47a-7ce3-404c-bcf9-548b24e946b9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.153868 Aug 07 10:55:32.332932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 104/207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:32 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:32.465766 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:32.466790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:32.476134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:32.476992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:32.477681 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:32.478599 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:32.479355 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:32.480124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:32.551224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:32.556004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a0167a84-b913-483f-9565-162fd0034bdb tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1310 microversion: 2.1 time: 0.094304 Aug 07 10:55:32.556569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 104/208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:32 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:33.071836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:33.072543 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:33.079641 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:33.080059 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:33.080487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:33.081253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:33.081734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:33.082156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:33.209860 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:33.217676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9abfefd2-5113-4824-b994-403f532aea8d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.149931 Aug 07 10:55:33.218236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 105/209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:33 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:33.352518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:33.353210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:33.359636 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:33.360132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:33.360637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:33.361365 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:33.361839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:33.362261 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:33.493374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:33.501887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8d80e27-96ad-43be-88cc-f7ce3a6715b2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1362 microversion: 2.1 time: 0.153147 Aug 07 10:55:33.502538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 105/210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:33 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:33.576765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:33.578001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:33.583954 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:33.584373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:33.584810 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:33.585519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:33.585974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:33.586396 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:33.700826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:33.711642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94841902-42f5-4cfc-8a68-0101864752e6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1310 microversion: 2.1 time: 0.138572 Aug 07 10:55:33.712480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 106/211] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:33 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1310 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:34.239283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:34.239827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:34.255899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.256400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.257305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.258265 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.258731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.259188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.442794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:34.450455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b67a42cc-3d47-418c-b8e1-f262c19ddf29 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.215052 Aug 07 10:55:34.451049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:34 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:34.524091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:34.524769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:34.531187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.531763 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.532196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.532878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.533359 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.534342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.679360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:34.687631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-921470a3-9767-44b9-adbc-d80a3a50dc8b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1549 microversion: 2.1 time: 0.167342 Aug 07 10:55:34.688211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 107/213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:34 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:34.710132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:34.710620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:34.717099 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.717623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.718056 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.718829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.719310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.719728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.734169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:34.734972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:34.741030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.741617 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.742278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.743091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:34.743666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:34.744180 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:34.832491 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:34.834770 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:34.841308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-50b2c243-35d0-4ce9-a66e-3ea4df6fe71d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1316 microversion: 2.1 time: 0.113486 Aug 07 10:55:34.841894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 108/214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:34 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1316 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:34.851189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a6f7109a-5c0c-4c17-9d88-145d50b2e5f1 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145030 Aug 07 10:55:34.851770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 107/215] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 10:55:34 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:35.472988 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:35.473640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:35.480257 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:35.480749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:35.481188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:35.481883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:35.482342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:35.482769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:35.610246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:35.617759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aaae25fc-a543-4f09-8e14-a0bce8827bd1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.148583 Aug 07 10:55:35.618332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 109/216] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:35 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:35.792503 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-6a000ad2-c47e-402c-a4ee-2f8083009b02 req-4cb7573f-3f3a-44e0-a7b2-d200aef3819c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad22310-bbff-4a4d-b3e1-08f2f0ee19bb", "tag": "7241f531-f113-4b1c-85e1-d78a8ccecdf7"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:35.802952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6a000ad2-c47e-402c-a4ee-2f8083009b02 req-4cb7573f-3f3a-44e0-a7b2-d200aef3819c service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:35.803567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6a000ad2-c47e-402c-a4ee-2f8083009b02 req-4cb7573f-3f3a-44e0-a7b2-d200aef3819c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:35.804092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6a000ad2-c47e-402c-a4ee-2f8083009b02 req-4cb7573f-3f3a-44e0-a7b2-d200aef3819c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:35.815745 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-6a000ad2-c47e-402c-a4ee-2f8083009b02 req-4cb7573f-3f3a-44e0-a7b2-d200aef3819c service nova] Creating event network-changed:7241f531-f113-4b1c-85e1-d78a8ccecdf7 for instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb on hv-cinder-85032 Aug 07 10:55:35.825458 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-6a000ad2-c47e-402c-a4ee-2f8083009b02 req-4cb7573f-3f3a-44e0-a7b2-d200aef3819c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038038 Aug 07 10:55:35.826232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 108/217] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:35.862138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:35.862698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:35.869104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:35.869595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:35.870026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:35.870730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:35.871218 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:35.871642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:35.938083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:35.945247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-69c14fe4-8e11-4cbe-a96d-a0f9cbe65022 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1316 microversion: 2.1 time: 0.087401 Aug 07 10:55:35.945828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 110/218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:35 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:36.640552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:36.641264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:36.647623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:36.648104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:36.648541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:36.649236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:36.649692 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:36.650149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:36.789532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:36.793177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:36.799325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-85a85041-c4f0-455e-bf8f-e9b783ba2cb9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.163623 Aug 07 10:55:36.799901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 109/219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:36 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:36.966100 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:36.966633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:36.973103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:36.973581 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:36.974016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:36.974694 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:36.975182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:36.975631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:37.039495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:37.047101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ca3ec7b0-0816-4139-8196-f6c7220b2340 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1316 microversion: 2.1 time: 0.084852 Aug 07 10:55:37.047658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 111/220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:36 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1316 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:37.821046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:37.821647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:37.828503 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:37.828978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:37.829404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:37.830084 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:37.830874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:37.831329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:37.969056 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:37.976402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-027d15a2-6dac-481c-8c84-20ec17811f9c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.159429 Aug 07 10:55:37.976991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 110/221] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:37 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:38.067630 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:38.068261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:38.074739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:38.075272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:38.075701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:38.076425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:38.077177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:38.077367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:38.141159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:38.148544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8f60f110-1b1c-46e6-8a7b-d79b0a53cb9d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1316 microversion: 2.1 time: 0.084660 Aug 07 10:55:38.149584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 112/222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:38 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1316 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:38.997918 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:38.998849 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:39.005297 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:39.005988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:39.006513 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:39.007362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:39.007890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:39.008381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:39.038264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:39.058723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=10 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:39.161645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:39.169049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:39.169525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-972afe59-b47b-45c6-bc0c-df49647cb4d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.175602 Aug 07 10:55:39.169658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:39.169970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 111/223] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:38 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:39.176814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:39.177300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:39.177733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:39.178426 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:39.178879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:39.179322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:39.209095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:39.245384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:39.253802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-14df14c2-0f3f-4870-a7ff-94df1b1bfdc5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1316 microversion: 2.1 time: 0.088532 Aug 07 10:55:39.254871 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 113/224] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:39 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:40.190255 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:40.193208 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:40.202316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:40.203197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:40.203640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:40.204682 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:40.205436 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:40.205883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:40.275437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:40.276112 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:40.283131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:40.283626 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:40.284063 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:40.284793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:40.285417 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:40.285992 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:40.438528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:40.447214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ae66b162-9011-4876-b488-d543c0070b9d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.261451 Aug 07 10:55:40.447926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 112/225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:40 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:40.531313 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:40.539521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94116fa5-82e2-4b3c-a871-855be68aa09a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.267582 Aug 07 10:55:40.540801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 114/226] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:40 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:41.061787 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-0b136742-0167-42c5-9227-ee551f68a36a req-4a3f092f-983e-444a-95df-887a9d88a3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423c8be-dde1-4173-8d7b-cf9be55ee8ca", "tag": "3cd59e35-98cf-47ca-bef7-d9000d1de278"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:55:41.070568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:41.081622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0b136742-0167-42c5-9227-ee551f68a36a req-4a3f092f-983e-444a-95df-887a9d88a3a3 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:41.082380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0b136742-0167-42c5-9227-ee551f68a36a req-4a3f092f-983e-444a-95df-887a9d88a3a3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:41.083680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0b136742-0167-42c5-9227-ee551f68a36a req-4a3f092f-983e-444a-95df-887a9d88a3a3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:41.098154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-0b136742-0167-42c5-9227-ee551f68a36a req-4a3f092f-983e-444a-95df-887a9d88a3a3 service nova] Creating event network-changed:3cd59e35-98cf-47ca-bef7-d9000d1de278 for instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca on hv-cinder-85032 Aug 07 10:55:41.103488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-0b136742-0167-42c5-9227-ee551f68a36a req-4a3f092f-983e-444a-95df-887a9d88a3a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047328 Aug 07 10:55:41.104202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 113/227] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:55:41.472833 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:41.474407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:41.482597 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:41.483435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:41.483910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:41.484602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:41.485366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:41.485784 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:41.565173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:41.566625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:41.575667 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:41.576360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:41.577084 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:41.578102 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:41.578917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:41.579393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:41.977647 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:41.986151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9f66a3c2-eed3-4648-acef-79097f01613a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.520608 Aug 07 10:55:41.986732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 115/228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:41 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:42.045480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:42.053000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-61e18a40-0036-418e-a085-81028b5cb9bf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.492413 Aug 07 10:55:42.063913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 114/229] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:41 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:43.010843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:43.011579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:43.029078 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:43.030594 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:43.033371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:43.036159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:43.038125 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:43.039379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:43.075699 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:43.078472 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:43.103022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:43.110501 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:43.118842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:43.119917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:43.120532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:43.146342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:43.380947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:43.396070 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ba8dc889-f6db-4f07-8149-0471a571b39d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.391115 Aug 07 10:55:43.408732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 116/230] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:43 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:43.425214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:43.435626 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-49596f89-a906-4db9-a2e2-e093b45666e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.363730 Aug 07 10:55:43.437087 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 115/231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:43 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:44.427311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:44.428443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:44.434953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:44.435909 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:44.436876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:44.437858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:44.438458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:44.438992 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:44.459197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:44.459805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:44.477178 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:44.477663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:44.480912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:44.481858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:44.482465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:44.483221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:44.755308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:44.762799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94eba59d-2d8c-44a9-aa69-0b3206f93c3b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.340063 Aug 07 10:55:44.767235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 117/232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:44 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:44.787855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:44.800213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-04a336cd-bf78-4778-bce1-931c05a6c761 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.343553 Aug 07 10:55:44.801398 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 116/233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:44 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:45.789755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:45.790370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:45.792802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=62 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:45.798330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:45.811758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:45.812865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:45.813894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:45.814501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:45.815034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:45.826736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:45.828074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:45.837811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:45.840289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:45.841603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:45.847512 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:45.849275 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:45.850013 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:46.101809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:46.116804 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-801846f2-4f76-43b0-95ca-cdeaf52b6233 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.330820 Aug 07 10:55:46.131680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:46.131680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-edf55b26-3055-4a96-9e52-d35a54e0c8b6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.310988 Aug 07 10:55:46.131680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 117/234] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:45 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:46.132908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 118/235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:45 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:47.143155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:47.144460 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:47.151369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:47.155103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:47.155788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:47.156730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:47.158020 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:47.158532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:47.161590 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:47.162797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:47.169560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:47.170412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:47.170983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:47.171695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:47.172252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:47.172797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:47.500170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:47.505321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:47.511242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fd9adf6a-cb96-45c1-bcf1-393cad4564b9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.356478 Aug 07 10:55:47.515400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-64b86397-4ede-4c84-8f67-42a35c522aa8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.377229 Aug 07 10:55:47.516207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 118/236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:47 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:47.519349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 119/237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:47 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:48.540362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:48.540964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:48.548211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:48.549682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:48.558458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:48.559068 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:48.560015 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:48.560183 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:48.560994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:48.561501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:48.561618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:48.562230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:48.562807 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:48.568680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:48.569687 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:48.584518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:48.927392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:48.936536 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a85de070-da0b-412c-a74d-f7e1baa1cf79 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.395920 Aug 07 10:55:48.937223 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 120/238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:48 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:48.937362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:48.945153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a0ccec8-1ffe-41ce-8f71-dd1c9815e570 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.408700 Aug 07 10:55:48.945900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 119/239] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:48 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:49.957666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:49.958276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:49.965162 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:49.965955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:49.966604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:49.967796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:49.968486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:49.969118 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:49.980172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:49.981614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:50.001343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:50.001847 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:50.002289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:50.003449 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:50.003910 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:50.004336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:50.338468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:50.351641 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-13201e13-23eb-46af-9b3b-2eb85c8caa22 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.397694 Aug 07 10:55:50.358980 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 121/240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:49 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:50.368788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:50.378014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a906a1b8-e604-463e-b1b9-980023af0df8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.404354 Aug 07 10:55:50.382965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 120/241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:49 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:51.372383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:51.373027 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:51.379433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:51.379925 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:51.380368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:51.381063 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:51.381516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:51.381942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:51.402591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:51.403776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:51.410963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:51.411659 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:51.412295 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:51.416352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:51.417047 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:51.417620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:51.616204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:51.628093 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5e8c3385-9178-4e44-8c32-3f3c31085f7f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.259789 Aug 07 10:55:51.628848 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 122/242] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:51 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:51.645002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:51.653413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f4f00017-ccfc-4e07-9d6a-b80cfef7ca32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.257741 Aug 07 10:55:51.654000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 121/243] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:51 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:52.648861 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:52.649478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:52.655933 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:52.656417 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:52.656856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:52.657542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:52.658003 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:52.658731 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:52.678592 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:52.680030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:52.686951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:52.688002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:52.688744 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:52.698671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:52.699213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:52.699706 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:52.887061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:52.900699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8ecb99be-1985-4a80-91a7-3c7b0f9f0b7b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.255526 Aug 07 10:55:52.902746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 123/244] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:52 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:52.946988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:52.958952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-85848cd5-460c-415e-9f9d-2f6152fff3c9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.286143 Aug 07 10:55:52.959736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 122/245] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:52 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:53.922182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:53.922817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:53.930082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:53.930600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:53.931075 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:53.931784 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:53.932376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:53.932804 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:53.981718 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:53.982385 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:53.988590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:53.989077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:53.989516 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:53.990210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:53.990668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:53.991125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:54.139938 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:54.149300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-69ed3248-07c8-4cd7-99c9-673d8ea72e65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.230037 Aug 07 10:55:54.166705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 124/246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:53 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:54.173364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:54.180898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-79e08773-f6cb-4aff-b5a1-8eecce41bb64 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.203017 Aug 07 10:55:54.181510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 123/247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:53 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:55.174749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:55.175463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:55.186634 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:55.188199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:55.195394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:55.196299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:55.196942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:55.197496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:55.204088 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:55.205521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:55.223532 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:55.230041 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:55.230699 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:55.231416 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:55.233179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:55.234017 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:55.234683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:55.461415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:55.478799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-42c68047-a59b-45a2-b693-f96ab3f9646e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.307059 Aug 07 10:55:55.479442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 125/248] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:55 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:55.480771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:55.493214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4107139f-6e57-4fdb-a5d0-359874352afd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.294143 Aug 07 10:55:55.493847 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 124/249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:55 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:55:56.501703 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:56.502314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:56.508565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:56.510850 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:56.511660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:56.512561 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:56.513177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:56.514538 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:56.516311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:56.517079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:56.529076 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:56.529790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:56.530407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:56.531184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:56.531649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:56.532077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:56.804932 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:56.811707 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:56.814240 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b3762844-2949-4d1c-aba0-e901ff4aa1ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.302669 Aug 07 10:55:56.814830 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 125/250] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:56 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:56.822253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3bcd1663-da65-4224-b84f-dc44a8e5eb82 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.325670 Aug 07 10:55:56.822970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 126/251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:56 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:57.836328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:57.836929 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:57.846164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:57.846664 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:57.847166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:57.847875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:57.848340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:57.848771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:57.851749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:57.852945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:57.863604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:57.864611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:57.881828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:57.887589 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:57.888445 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:57.890163 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:58.055502 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:58.065794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3d2aff8c-9db5-4d88-8e87-34d2a628c588 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.233276 Aug 07 10:55:58.066803 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 126/252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:57 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:58.096826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:58.106321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b7d86f67-558c-4120-b35b-1c4891a3c345 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.261574 Aug 07 10:55:58.120730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 127/253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:57 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:59.089450 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:59.090080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:59.097308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:59.097796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:59.098234 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:59.098942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:59.099492 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:59.099859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:59.103902 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:59.129381 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:55:59.130497 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:55:59.137602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:59.138176 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:59.139227 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:59.140067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:55:59.140928 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:55:59.141422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:55:59.310060 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:59.323698 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c5165cb3-33bb-4833-ad1c-78b47a913274 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.236358 Aug 07 10:55:59.325504 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 127/254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:59 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:55:59.348689 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:55:59.356391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d669399b-3bb1-4e34-a02a-9b20af6ea1e2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.231716 Aug 07 10:55:59.356906 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 128/255] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:55:59 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:00.348743 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:00.349354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:00.355748 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:00.356141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:00.356841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:00.358137 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:00.358597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:00.359070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:00.380431 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:00.381075 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:00.388186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:00.389359 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:00.389955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:00.390705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:00.391201 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:00.391629 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:00.564904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:00.572376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9f2a528f-04ba-4739-a93f-9f165dbe2159 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.227398 Aug 07 10:56:00.572942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 128/256] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:00 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:00.589014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:00.598780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a3dae89a-a981-44c2-b07c-9a24794144b8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.222486 Aug 07 10:56:00.599385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 129/257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:00 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:01.593620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:01.594234 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:01.600359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:01.600843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:01.601279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:01.601964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:01.602420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:01.602846 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:01.621033 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:01.621732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:01.628550 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:01.629005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:01.629434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:01.630115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:01.630593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:01.631039 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:01.788685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:01.796901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fa5ede2c-da07-4653-bd09-b37655527a4e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.207265 Aug 07 10:56:01.797473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 129/258] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:01 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:01.811461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:01.819193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4cd3db6e-0a5a-4bf0-9033-2b6af7938efe tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.201998 Aug 07 10:56:01.819758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 130/259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:01 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:02.227561 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-853418817", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:02.279676 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] validate_networks() for None {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:56:02.552353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:56:02.552988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:56:02.553553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:56:02.553869 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:56:02.554285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:56:02.563887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:02.564372 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:02.564802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:02.565558 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:02.566038 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:02.566489 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:02.583169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Getting quotas for project 2f306584e65048f98a4128cafc1b210c. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:56:02.587088 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Getting quotas for user aeb2182f9b614007b61823075835fe33 and project 2f306584e65048f98a4128cafc1b210c. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:56:02.599050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:56:02.601298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:56:02.660964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5dc6276c-ca83-4f47-9670-22ff7d511329 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.436829 Aug 07 10:56:02.661790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 130/260] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:56:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:56:02.672910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ec5bdfd8-4288-42b3-bae2-e5d2f238af11 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:02.673603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ec5bdfd8-4288-42b3-bae2-e5d2f238af11 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:02.752737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ec5bdfd8-4288-42b3-bae2-e5d2f238af11 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:02.759577 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ec5bdfd8-4288-42b3-bae2-e5d2f238af11 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1214 microversion: 2.1 time: 0.090999 Aug 07 10:56:02.760230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 131/261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:02 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:02.818845 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:02.819660 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:02.826337 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:02.827109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:02.827728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:02.828450 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:02.828872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:02.829274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:02.840599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:02.842119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:02.854470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:02.855177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:02.855947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:02.856664 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:02.857330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:02.857766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:03.048703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:03.056246 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-baef6ff4-bd1e-483e-8d54-3d0b4513cbc4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.242526 Aug 07 10:56:03.056820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 131/262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:02 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:03.095337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:03.111060 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7cc66315-1c8a-4b4a-8d8b-8a9c1bab85ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.274758 Aug 07 10:56:03.118960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 132/263] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:02 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:03.785684 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:03.786305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:03.808065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:03.808760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:03.809801 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:03.812783 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:03.814698 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:03.815691 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:03.957502 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:03.965292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-40d1a886-d32e-4560-af1d-d02526379bab tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1266 microversion: 2.1 time: 0.187175 Aug 07 10:56:03.965858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 132/264] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:03 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:04.078161 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:04.078772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:04.085453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.085932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.086366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.087085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.087545 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.087967 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.134117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:04.134905 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:04.141978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.142614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.143089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.143961 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.144568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.145482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.301878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:04.312023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-480c4c83-4fd1-4ad5-b823-b0066bf63b2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.238133 Aug 07 10:56:04.321136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 133/265] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:04 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:04.334276 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:04.343578 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a340e6b-7653-45f1-b9f3-3cfda9a4e181 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.213777 Aug 07 10:56:04.344166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 133/266] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:04 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:04.369778 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:04.370278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:04.377026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.377435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.377897 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.378755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.379239 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.379666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.403908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 10:56:04.490306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d095645f-f73c-4a73-a700-320792c07649 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "DELETE /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 204 len: 0 microversion: 2.1 time: 0.124055 Aug 07 10:56:04.490897 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 134/267] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 10:56:04 2022] DELETE /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 10:56:04.499700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:04.500487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:04.507082 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.507619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.508059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.508913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.509376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.509877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.667092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:04.676584 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-693ade15-837c-4260-b2e9-9bb3c9c2c32d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.181465 Aug 07 10:56:04.677157 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 134/268] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:04 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:04.987284 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:04.987901 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:04.993754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.994230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.994668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:04.995381 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:04.995837 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:04.996263 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:05.058116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:05.066320 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ad4bc446-9ddb-4fd5-9c21-c0f9f36a4ff3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1274 microversion: 2.1 time: 0.084426 Aug 07 10:56:05.066875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 135/269] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:04 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:05.334133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:05.334759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:05.341788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:05.342348 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:05.342816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:05.343603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:05.344063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:05.344514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:05.364338 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:05.364989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:05.371209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:05.371683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:05.372107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:05.372940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:05.373542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:05.373961 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:05.546289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:05.554018 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f39bc0db-0832-419d-ba49-2fbe65cf9693 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.223825 Aug 07 10:56:05.554812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 135/270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:05 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:05.567619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:05.574973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f1d8f5bc-ccce-476f-a8a1-ab5567dc8e93 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.214460 Aug 07 10:56:05.575534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 136/271] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:05 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:05.697344 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:05.697957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:05.705343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:05.706277 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:05.706826 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:05.707805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:05.708330 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:05.708759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:05.839507 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:05.847941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8fb90f4-dd6d-42e4-953a-cea264afcf3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.154514 Aug 07 10:56:05.848539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 136/272] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:05 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:06.086374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:06.086950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:06.093232 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.093713 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.094147 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:06.094828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.095307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.095726 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:06.299210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:06.306624 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f97bbc05-0254-40b6-bdf1-c6fbe4268d7e tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1274 microversion: 2.1 time: 0.224090 Aug 07 10:56:06.307224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 137/273] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:06 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:06.573708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:06.574311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:06.580345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.580827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.581260 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:06.581942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.582483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.582816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:06.595752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:06.596428 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:06.602688 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.603351 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.603790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:06.604483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.604941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.605366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:06.778788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:06.790158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a15f56d0-1f56-4da6-b6aa-fd16b2bdb6d4 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1520 microversion: 2.1 time: 0.219904 Aug 07 10:56:06.803367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:06.804263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 137/274] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:06 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:06.809406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-effb99f0-fa85-4219-9eb3-90a6b5e16008 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.217438 Aug 07 10:56:06.811262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 138/275] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:06 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:06.868658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:06.869269 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:06.876689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.877317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.877846 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:06.878968 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:06.879553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:06.880049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:07.069290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:07.078151 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1071edd4-5115-42b8-b67f-05363bf2859b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.213331 Aug 07 10:56:07.078736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 138/276] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:06 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:07.329121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:07.329843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:07.336028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:07.336604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:07.337042 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:07.337730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:07.338178 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:07.338597 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:07.399955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:07.408044 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8484dbf1-4347-4c6b-8435-a5c58728645f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1284 microversion: 2.1 time: 0.083738 Aug 07 10:56:07.408606 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 139/277] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:07 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:07.813778 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:07.814388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:07.820325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:07.820810 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:07.821247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:07.821943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:07.822403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:07.822826 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:07.832655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:07.833273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:07.839641 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:07.840128 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:07.840564 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:07.841259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:07.841716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:07.842144 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:08.046089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:08.050311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:08.053498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-54054854-04f1-43ed-91b4-290c2dd4a560 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1500 microversion: 2.1 time: 0.244158 Aug 07 10:56:08.054061 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 139/278] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:07 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1500 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:08.057830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d81afef4-0a62-46bd-8225-0a4af9ae079d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.228951 Aug 07 10:56:08.058486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 140/279] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:07 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:08.074338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:08.074878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:08.080815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:08.081302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:08.081734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:08.082419 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:08.082877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:08.083325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:08.097638 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:08.098248 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:08.104382 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:08.104933 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:08.105433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:08.106183 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:08.107341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:08.108163 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:08.123565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:08.282705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:08.290262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-aa0bdab8-46f9-4014-9afd-edfd9520d07e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1514 microversion: 2.1 time: 0.219665 Aug 07 10:56:08.290950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 140/280] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:08 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:08.294083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:08.303552 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d7b4daaf-4fc9-4f38-851f-f88eeb46f122 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.209671 Aug 07 10:56:08.304117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 141/281] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:08 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:08.429448 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:08.430399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:08.443763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:08.444531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:08.445055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:08.445778 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:08.446228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:08.446674 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:08.510433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:08.518165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e3c157a7-9bb0-4f9e-8f52-383fbdc0cd07 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1284 microversion: 2.1 time: 0.092445 Aug 07 10:56:08.518763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 141/282] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:08 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:09.079809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:09.080414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:09.086777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:09.087287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:09.087720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:09.088404 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:09.088861 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:09.089278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:09.225023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:09.232452 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0e67e169-0b08-4deb-81d1-a7193c444dc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.157581 Aug 07 10:56:09.233294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 142/283] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:09 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:09.324623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:09.325226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:09.331823 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:09.332296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:09.332727 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:09.333405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:09.333850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:09.334267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:09.462971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:09.471327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-29c14bc6-db75-48b9-956b-0b6dbce85c3b tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.150447 Aug 07 10:56:09.471893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 142/284] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:09 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:09.539254 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:09.539865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:09.546851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:09.547370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:09.547806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:09.548500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:09.548956 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:09.549384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:09.612508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:09.620016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eccf0101-de86-418e-8e79-916fd4de3e63 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1272 microversion: 2.1 time: 0.084493 Aug 07 10:56:09.620598 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 143/285] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:09 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:10.253420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:10.254026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:10.259900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:10.260378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:10.260807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:10.261485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:10.261936 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:10.262355 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:10.393833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:10.401202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7c780a30-7f8f-4f62-be70-f4f3c3540157 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.151647 Aug 07 10:56:10.401756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 143/286] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:10 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:10.493091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:10.493705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:10.500245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:10.500733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:10.501169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:10.501864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:10.502324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:10.502752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:10.642533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:10.643307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:10.643923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:10.649772 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:10.650255 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:10.650700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:10.651077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-810a7480-3191-4bd0-bd42-d9e456ea34d5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.162082 Aug 07 10:56:10.651424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:10.651805 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 144/287] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:10 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:10.651910 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:10.652300 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:10.670839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:10.723189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:10.723420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9f41cf42-d469-419f-a797-f1e240342ab6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1272 microversion: 2.1 time: 0.084373 Aug 07 10:56:10.723976 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 144/288] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:10 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:11.422135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:11.422852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:11.428624 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:11.429103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:11.429534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:11.430214 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:11.430668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:11.431130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:11.567702 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:11.580138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f5ffa11-382c-4ecb-a53f-a4651642ae57 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.162093 Aug 07 10:56:11.581061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 145/289] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:11 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:11.671522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:11.672119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:11.673995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:11.679354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:11.679838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:11.680271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:11.680956 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:11.681407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:11.681824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:11.745481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:11.746092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:11.752757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:11.753242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:11.753668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:11.754364 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:11.754830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:11.755262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:11.827865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:11.835582 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-04c4e1cd-e68c-4114-9946-636efbb45c55 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1272 microversion: 2.1 time: 0.093893 Aug 07 10:56:11.836356 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 146/290] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:11 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:11.842613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:11.850703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-02e66f9c-b8ef-4a1c-ba8e-d01ad295856d tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.183502 Aug 07 10:56:11.851300 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 145/291] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:11 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:12.613433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:12.614370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:12.621062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:12.621847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:12.623632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:12.624160 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:12.624833 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:12.625292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:12.758938 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:12.842239 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:12.850210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-269d52eb-0f5e-4783-abf7-e8ad09dd7bbf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.240576 Aug 07 10:56:12.851818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 147/292] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:12 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:12.857120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:12.858041 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:12.859984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:12.860663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:12.867364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:12.867872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:12.868303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:12.868999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:12.869457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:12.869886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:12.872858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:12.873474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:12.879781 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:12.880267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:12.880839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:12.881547 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:12.882006 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:12.882426 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:12.962116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:12.969898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6c7bb619-67f9-4319-8ef0-36874be0e969 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1272 microversion: 2.1 time: 0.116734 Aug 07 10:56:12.970463 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 146/293] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:12 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:13.152679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:13.163734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-157e866b-a75b-4af0-b82c-05474ce37468 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1552 microversion: 2.1 time: 0.295320 Aug 07 10:56:13.175908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 148/294] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:12 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1552 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:13.794401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-eeb7065d-82c8-4e3a-842d-68941c119d77 req-d50358b3-a343-430b-9624-723e2e119c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685facdf-09b2-422e-910a-4f139dbd14ca", "name": "network-vif-deleted", "tag": "1363236b-856c-4b92-8ec6-73e370811703"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:13.803536 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-eeb7065d-82c8-4e3a-842d-68941c119d77 req-d50358b3-a343-430b-9624-723e2e119c4e service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:13.804023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-eeb7065d-82c8-4e3a-842d-68941c119d77 req-d50358b3-a343-430b-9624-723e2e119c4e service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:13.804423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-eeb7065d-82c8-4e3a-842d-68941c119d77 req-d50358b3-a343-430b-9624-723e2e119c4e service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:13.815679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-eeb7065d-82c8-4e3a-842d-68941c119d77 req-d50358b3-a343-430b-9624-723e2e119c4e service nova] Creating event network-vif-deleted:1363236b-856c-4b92-8ec6-73e370811703 for instance 685facdf-09b2-422e-910a-4f139dbd14ca on hv-cinder-85032 Aug 07 10:56:13.820780 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-eeb7065d-82c8-4e3a-842d-68941c119d77 req-d50358b3-a343-430b-9624-723e2e119c4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 Aug 07 10:56:13.821349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 147/295] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:13.875757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:13.876402 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:13.883197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:13.883900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:13.884497 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:13.885246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:13.885696 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:13.886114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:13.908320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:13.910846 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:13.919522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:13.920024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:13.920451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:13.921139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:13.921589 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:13.922014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:13.945994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lazy-loading 'flavor' on Instance uuid e465ec9d-f167-4410-b5dd-95c885e888a4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:56:14.033438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:14.041701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b56c8294-f009-4342-8c7b-904f08e95365 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.170692 Aug 07 10:56:14.042459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 149/296] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:13 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:14.061716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:14.062369 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:14.068498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:14.068978 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:14.069421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:14.070214 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:14.070342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-05cd880b-e648-4f97-821c-e42cc1a62a43 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4/action" status: 200 len: 32 microversion: 2.1 time: 0.166617 Aug 07 10:56:14.070668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:14.071027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 148/297] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:56:13 2022] POST /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 10:56:14.071142 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:14.080613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:14.081309 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:14.087475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:14.087967 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:14.088465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:14.089166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:14.089798 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:14.090233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:14.267669 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:14.275323 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c2d4777e-1269-465a-b42c-8ea5aed07a03 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.219072 Aug 07 10:56:14.275986 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 150/298] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:14 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:14.287167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:14.287302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:14.287302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:14.287454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2f65700e-5f57-4e66-91b5-cbe8bcf42863 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.209132 Aug 07 10:56:14.287454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 149/299] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:14 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:14.287587 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:14.288062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:14.288666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:14.289372 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:14.289831 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:14.290265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:14.361947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:14.374686 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cb679d49-f00a-4b80-8b04-56fd60baa83e tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1510 microversion: 2.1 time: 0.097475 Aug 07 10:56:14.375569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 151/300] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:14 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1510 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:15.068371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:15.068957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:15.074901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.075598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.076029 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.076842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.077288 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.077703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.217158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:15.225158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bda1120d-1d76-46cf-a14d-a011c2b73d17 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.160558 Aug 07 10:56:15.225859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 150/301] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:15 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:15.297963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:15.298602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:15.305231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.305667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.306287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.307023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.307487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.307911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.308359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:15.309177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:15.316026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.316495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.317164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.317927 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.318454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.319119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.532358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:15.539629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:15.540541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ec85c1c6-e87a-47d7-8267-b4e854ca48b4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.247475 Aug 07 10:56:15.541347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 152/302] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:15 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:15.554299 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0926dcb9-0d83-4d29-b566-8960032db314 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.245414 Aug 07 10:56:15.554430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:15.554509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 151/303] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:15 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:15.554600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:15.556640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.557128 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.557595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.558448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:15.558961 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:15.559403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:15.624251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:15.633223 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-740525d5-1d98-43d9-ae5e-292c795aece3 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1510 microversion: 2.1 time: 0.089182 Aug 07 10:56:15.633966 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 153/304] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:15 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:16.250720 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:16.251877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:16.258990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:16.259476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:16.259904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:16.260677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:16.261291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:16.261853 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:16.413394 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:16.420973 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-19acfee9-7e94-47a1-8947-a025ba85472c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.176765 Aug 07 10:56:16.436871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 152/305] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:16 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:16.563639 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:16.564384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:16.568631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:16.572248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:16.572876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:16.573437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:16.573885 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:16.574282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:16.576023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:16.576910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:16.577661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:16.592386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:16.593714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:16.594517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:16.597577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:16.598036 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:16.600315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:17.081597 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:17.089501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-163f7f79-d890-48c5-8aef-5930e35b623d tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.531326 Aug 07 10:56:17.090073 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 154/306] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:16 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:17.095849 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:17.096549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:17.103306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:17.103790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:17.104221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:17.104917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:17.105658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:17.106382 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:17.110476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:17.122509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e32143ca-66c3-472c-bc4d-5943f3bde223 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.555996 Aug 07 10:56:17.125143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 153/307] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:16 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:17.195295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:17.206981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b356b962-8f65-4af5-805f-1dbffafc929a tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1345 microversion: 2.1 time: 0.114844 Aug 07 10:56:17.222655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 155/308] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:17 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:17.446014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:17.447674 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:17.456975 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:17.458225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:17.458992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:17.460380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:17.461586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:17.462297 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:17.548396 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-38807a6e-3883-403e-ad98-05c32f633716 req-3a919172-be11-4500-9ea1-b564343acc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c3d6440-4150-4ad0-a18b-4032f8ac83dd", "tag": "099e595c-263d-4107-85f3-a8026451b3c9"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:17.558245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-38807a6e-3883-403e-ad98-05c32f633716 req-3a919172-be11-4500-9ea1-b564343acc77 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:17.558941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-38807a6e-3883-403e-ad98-05c32f633716 req-3a919172-be11-4500-9ea1-b564343acc77 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:17.559386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-38807a6e-3883-403e-ad98-05c32f633716 req-3a919172-be11-4500-9ea1-b564343acc77 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:17.573096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-38807a6e-3883-403e-ad98-05c32f633716 req-3a919172-be11-4500-9ea1-b564343acc77 service nova] Creating event network-changed:099e595c-263d-4107-85f3-a8026451b3c9 for instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd on hv-cinder-85032 Aug 07 10:56:17.578621 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-38807a6e-3883-403e-ad98-05c32f633716 req-3a919172-be11-4500-9ea1-b564343acc77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034246 Aug 07 10:56:17.579244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 156/309] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:56:17.750677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:17.758544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-785e4b30-8f03-4824-a91b-35d8edee025b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.318702 Aug 07 10:56:17.759012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 154/310] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:17 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:18.112769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:18.113768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:18.120010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.120496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.121198 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.122051 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.122792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.123453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.146340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:18.147467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:18.155333 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.156167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.157050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.158096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.158725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.159173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.434400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:18.442353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:18.446061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3de339cd-b1af-4ed2-8505-ac3e8fcb8818 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.337384 Aug 07 10:56:18.446840 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 157/311] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:18 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:18.460077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7dcfd738-af31-4448-a1c0-66764eeee0ae tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.310327 Aug 07 10:56:18.460077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 155/312] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:18 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:18.460077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:18.460077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:18.465360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.466966 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.467523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.468292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.468835 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.469364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.549130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:18.557602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7e125d06-f9ca-453a-8501-f4540fc1a7b1 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1345 microversion: 2.1 time: 0.104053 Aug 07 10:56:18.558351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 156/313] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:18 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:18.779915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:18.781817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:18.789632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.790285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.791035 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.791899 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:18.792504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:18.795284 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:18.989728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:18.992064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:18.999434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-659f3570-78aa-4cae-824f-5f6ebbf83656 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.223907 Aug 07 10:56:19.000005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 158/314] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:18 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:19.467918 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:19.468526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:19.476014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:19.476405 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:19.476521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:19.476876 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:19.477050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:19.477575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:19.478034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:19.478458 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:19.483754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:19.484242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:19.484847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:19.485705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:19.486534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:19.487138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:19.967768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:19.975906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-44b144c3-97a0-4410-8ccb-fcfc19996ec1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.512340 Aug 07 10:56:19.976460 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 157/315] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:19 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:19.981917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:19.982388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:19.983690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:19.989897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:19.990426 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:19.990866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:19.991646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:19.992105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:19.992532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:19.999478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-caa78453-a615-4b55-986e-725abef59e4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.522372 Aug 07 10:56:19.999924 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 159/316] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:19 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:20.020950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:20.021583 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:20.027523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:20.028014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:20.029102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:20.029803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:20.030262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:20.030691 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:20.096898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:20.106574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3a585864-a829-4bbd-9ae3-07c0ba6d7eb5 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1345 microversion: 2.1 time: 0.128695 Aug 07 10:56:20.107462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 158/317] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:19 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:20.242398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:20.250447 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-675630fe-1905-47b6-a22b-6fd5ec8bfe75 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.233172 Aug 07 10:56:20.251142 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 160/318] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:20 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:20.995951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:20.998701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:21.006058 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.006754 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.007490 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.008838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.009503 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.010123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.024208 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:21.025537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:21.050126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.050724 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.051288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.052084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.052612 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.053105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.462515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:21.471950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:21.493824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e90e342f-3a23-416c-8b21-cb7fd29d4996 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.501668 Aug 07 10:56:21.501671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 159/319] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:20 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:21.509884 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:21.510962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:21.524629 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:21.533488 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c342ffbc-be0a-44fb-8644-3a6fcb3dbb23 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.515926 Aug 07 10:56:21.536186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 161/320] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:21 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:21.537643 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.538395 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.539065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.539989 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.540652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.541613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.555052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:21.555757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:21.579456 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.582854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.583464 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.584206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:21.587819 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:21.588473 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:21.657150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:21.674914 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-001a9991-3f54-4e29-9f9b-8979de610219 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1345 microversion: 2.1 time: 0.164777 Aug 07 10:56:21.676756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 160/321] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:21 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:21.883234 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:21.895101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a6f08e72-823f-489e-86cb-64a4f2537072 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.354937 Aug 07 10:56:21.895925 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 162/322] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:21 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:22.523791 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:22.524944 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:22.532484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.532868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.533300 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:22.533994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.534445 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.534872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:22.554896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:22.556528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:22.569179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.570087 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.570632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:22.571680 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.572495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.572992 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:22.762145 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:22.777716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fa1fb470-6e81-4234-9190-dac38a84c16b tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.257720 Aug 07 10:56:22.788340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 161/323] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:22 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:22.794705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:22.795483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:22.802186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.803035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.803689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:22.804650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.805328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.805780 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:22.814483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:22.826959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33fdbf4d-76eb-4b1f-9541-f5e3dda594b7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.273622 Aug 07 10:56:22.831631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 163/324] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:22 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:22.887349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:22.900382 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4ff2c335-797d-45d7-9150-04b5c43c5c49 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1345 microversion: 2.1 time: 0.109534 Aug 07 10:56:22.901079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 162/325] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:22 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:22.923649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:22.924753 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:22.931395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.931883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.932313 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:22.933010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:22.933628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:22.934052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:23.163791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:23.171670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-242a9d08-bf42-4e61-8a4f-7b9aa4a8e883 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.255479 Aug 07 10:56:23.172244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 164/326] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:22 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:23.801166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:23.802334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:23.809895 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:23.810709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:23.811483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:23.812375 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:23.813040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:23.813528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:23.849569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:23.850489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:23.860418 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:23.861208 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:23.861752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:23.862738 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:23.863359 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:23.864156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:24.142155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:24.157435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0f11354c-6ae0-483b-a997-f531b211b2b3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.312565 Aug 07 10:56:24.159543 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 165/327] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:23 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:24.166125 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:24.167295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:24.179933 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:24.180852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:24.181468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:24.186462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:24.190520 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:24.193566 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:24.194021 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:24.199416 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-113247b9-a76b-4536-a3f7-1636f2ed2a36 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.402057 Aug 07 10:56:24.200554 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 163/328] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:23 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:24.208389 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:24.209190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:24.216700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:24.217193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:24.217633 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:24.218333 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:24.218793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:24.219248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:24.296731 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:24.308117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4b0c53a6-2fcf-4ee9-a804-80f9b74b3543 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1345 microversion: 2.1 time: 0.147239 Aug 07 10:56:24.308924 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 166/329] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:24 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:24.401714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:24.426319 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6da37b1f-a7d2-4d19-b298-b0c5fe3d71a2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.224532 Aug 07 10:56:24.427129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 164/330] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:24 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:24.604040 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-182a8d81-ba98-45f5-93b0-2ea3e07540b9 req-c9f97fc7-f2d7-4e59-8fcc-e5e2959f6074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b423c8be-dde1-4173-8d7b-cf9be55ee8ca", "name": "network-vif-plugged", "status": "completed", "tag": "3cd59e35-98cf-47ca-bef7-d9000d1de278"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:24.618113 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-182a8d81-ba98-45f5-93b0-2ea3e07540b9 req-c9f97fc7-f2d7-4e59-8fcc-e5e2959f6074 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:24.618756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-182a8d81-ba98-45f5-93b0-2ea3e07540b9 req-c9f97fc7-f2d7-4e59-8fcc-e5e2959f6074 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:24.619333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-182a8d81-ba98-45f5-93b0-2ea3e07540b9 req-c9f97fc7-f2d7-4e59-8fcc-e5e2959f6074 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:24.637972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-182a8d81-ba98-45f5-93b0-2ea3e07540b9 req-c9f97fc7-f2d7-4e59-8fcc-e5e2959f6074 service nova] Creating event network-vif-plugged:3cd59e35-98cf-47ca-bef7-d9000d1de278 for instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca on hv-cinder-85032 Aug 07 10:56:24.640851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-182a8d81-ba98-45f5-93b0-2ea3e07540b9 req-c9f97fc7-f2d7-4e59-8fcc-e5e2959f6074 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040414 Aug 07 10:56:24.641634 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 167/331] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:25.180813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:25.181440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:25.188146 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.188646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.189085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.189791 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.190250 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.190680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.224864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:25.239671 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:25.250287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.250792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.251269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.252024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.252542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.263946 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.490747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:25.501309 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2666e343-2a97-430b-bd55-943891e92330 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.324595 Aug 07 10:56:25.501890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 165/332] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:25 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:25.519301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:25.520691 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:25.539132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.539845 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.540483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.541418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.551795 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.552630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.570038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:25.579244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1e5b9347-de80-43c2-8c2f-174f86329fd0 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.361941 Aug 07 10:56:25.593003 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 168/333] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:25 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:25.600748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:25.607144 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:25.616998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.621141 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.622204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.623200 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:25.623865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:25.624487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:25.672085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:25.683943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-49059b7f-558b-42b2-b44b-9710d15bed09 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1345 microversion: 2.1 time: 0.179790 Aug 07 10:56:25.685948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 166/334] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:25 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:25.869457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:25.882209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a2bb3de5-9ed1-4b94-a6f2-035ffe933467 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.286316 Aug 07 10:56:25.899896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 169/335] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:25 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:26.523560 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:26.524269 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:26.534519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:26.558238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:26.561317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:26.576646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:26.577767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:26.580901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:26.600001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:26.600695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:26.631179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:26.631871 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:26.632325 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:26.633081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:26.633548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:26.633982 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:27.230139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:27.239804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-22e9d8e3-3d28-49b3-981a-72783e6333e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.720633 Aug 07 10:56:27.246310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 167/336] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:26 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:27.263776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:27.264467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:27.274042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:27.274741 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:27.277805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:27.278762 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:27.279382 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:27.279813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:27.383999 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:27.396947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6f0348d8-7558-4f3c-97ae-571596d45ea4 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.800695 Aug 07 10:56:27.399637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:27.400160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:27.405211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 170/337] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:26 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:27.439388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:27.439903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lazy-loading 'fault' on Instance uuid 685facdf-09b2-422e-910a-4f139dbd14ca {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:56:27.448773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:27.450184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:27.472712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:27.479945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:27.481836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:27.483111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:27.487230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:27.487923 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:27.657795 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616a497708664cca8bf7cfe93cbfd01f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d2c614e07df4a29b2cd84c260fdc93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:27.665986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e992ca47-42eb-4600-a639-b2ec5e5a622c tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 200 len: 1304 microversion: 2.1 time: 0.417332 Aug 07 10:56:27.667443 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 168/338] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:27 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 1304 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:27.957374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:27.970701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f51867a7-a927-4e39-b999-9c46ed3b8c84 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.532660 Aug 07 10:56:27.971336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 171/339] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:27 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:28.268315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:28.268983 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:28.295002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:28.295390 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:28.295830 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:28.296574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:28.300467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:28.301224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:28.428237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:28.428863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:28.439010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:28.439564 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:28.440156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:28.440884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:28.441350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:28.441946 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:28.556678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:28.579756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f942b4a8-a4e4-4819-af32-dcbc71d5acd9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.309238 Aug 07 10:56:28.581209 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 169/340] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:28 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:28.688916 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:28.690608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:28.702638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:28.708481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:28.709292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:28.710729 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:28.711444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:28.712287 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:28.756380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] HTTP exception thrown: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Request method failure captured: Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca HTTP/1.1 Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ngEZayRcvLKNz-fbJT1SfOZpIxNcwXnoG8pWa8Pg6IqWfJQbPoJFD4O4t9ZKsjfKu5DZVwSzZ9Jd-nvj9n50yN-QEfI7K1txto5p6zXKAWcNqlq6qWNYDDl509SVo9T35kLTAKQOoHjk76tHrnKPHhaURJofw4RPCfH1dkG-WoahE Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:56:28.762378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2d2c614e07df4a29b2cd84c260fdc93a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 616a497708664cca8bf7cfe93cbfd01f Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:28.763822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '685facdf-09b2-422e-910a-4f139dbd14ca'} Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:56:28.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:28.765805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:28.768634 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Returning 404 to user: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:56:28.769806 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a36b2e3b-32a8-4311-a736-5e5fa79c3bfd tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 404 len: 111 microversion: 2.1 time: 0.086092 Aug 07 10:56:28.771117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 170/341] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:28 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:56:28.846293 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:28.854751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8fa20668-12e7-4f60-a61a-0c46f4e4659c tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.433384 Aug 07 10:56:28.855611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 172/342] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:28 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:28.993705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:28.994359 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:29.004791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.005347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.008265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:29.011208 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.012985 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.013883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:29.056908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-44192b6d-fded-4b8a-acb2-14fa74a01116 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Action: 'create', calling method: .version_select at 0x7fc5ee5b0ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1322765706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIbkKApwDcWEPTv5xhMwg1+nSwA6+cK0QjAP1yS0SDMATYDKrmSzqFXnZuftNrOHrIK9yEk/6anOKFxRBsNBmWA5FBTxxs02/Umo0P8VfJ/aa5Dbi/LRpwSWSRlJERw4Q=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:29.091698 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-44192b6d-fded-4b8a-acb2-14fa74a01116 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Getting quotas for project 758665157bfd4f7fa6219f898a9c99a2. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:56:29.096656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-44192b6d-fded-4b8a-acb2-14fa74a01116 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Getting quotas for user 8cb8ad1bff7f4e439cefdf6f0ef9a2d0 and project 758665157bfd4f7fa6219f898a9c99a2. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:56:29.149302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-44192b6d-fded-4b8a-acb2-14fa74a01116 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.376786 Aug 07 10:56:29.151089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 171/343] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 10:56:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:29.170147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:29.186365 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:29.205286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.206695 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.209877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:29.211022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.212590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.214002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:29.235422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] HTTP exception thrown: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Request method failure captured: Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca/os-volume_attachments HTTP/1.1 Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ngEZayRcvLKNz-fbJT1SfOZpIxNcwXnoG8pWa8Pg6IqWfJQbPoJFD4O4t9ZKsjfKu5DZVwSzZ9Jd-nvj9n50yN-QEfI7K1txto5p6zXKAWcNqlq6qWNYDDl509SVo9T35kLTAKQOoHjk76tHrnKPHhaURJofw4RPCfH1dkG-WoahE Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:56:29.237638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2d2c614e07df4a29b2cd84c260fdc93a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 616a497708664cca8bf7cfe93cbfd01f Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:29.239198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'server_id': '685facdf-09b2-422e-910a-4f139dbd14ca'} Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:56:29.239950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:29.241409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:29.242557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Returning 404 to user: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:56:29.242557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-66932803-6929-4289-958c-bfb1ac13cd6f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.086867 Aug 07 10:56:29.242557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 172/344] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 10:56:29 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca/os-volume_attachments => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:56:29.271279 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:29.279337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-163d1147-8bdf-4540-b640-10e92e8d32b4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1358 microversion: 2.1 time: 0.290226 Aug 07 10:56:29.279922 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 173/345] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:28 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:29.600142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:29.600758 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:29.610588 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.611142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.612594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:29.613315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.615932 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.616597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:29.839434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:29.848575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-82bd746c-681d-4067-8847-f7b79598f738 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.252399 Aug 07 10:56:29.849550 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 173/346] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:29 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:29.878867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:29.879575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:29.892878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.894002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.894882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:29.895938 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:29.896527 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:29.897003 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.072888 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:30.088940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7b594f61-8291-4989-a90a-1f16622794da tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.213853 Aug 07 10:56:30.089666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 174/347] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:29 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:30.301451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:30.301664 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:30.307697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.308180 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.308804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.310396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.310878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.311332 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.460828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:30.469257 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bf532e4b-07c2-4bae-82db-e00954815efc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1547 microversion: 2.1 time: 0.172327 Aug 07 10:56:30.470159 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 174/348] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:30 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:30.491618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:30.492233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:30.499386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.500219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.500658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.501360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.502019 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.502444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.645752 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:30.646314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:30.654172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.658629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.659485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.660403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.661051 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.661657 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.683319 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:30.683610 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] HTTP exception thrown: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Request method failure captured: Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca HTTP/1.1 Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ngEZayRcvLKNz-fbJT1SfOZpIxNcwXnoG8pWa8Pg6IqWfJQbPoJFD4O4t9ZKsjfKu5DZVwSzZ9Jd-nvj9n50yN-QEfI7K1txto5p6zXKAWcNqlq6qWNYDDl509SVo9T35kLTAKQOoHjk76tHrnKPHhaURJofw4RPCfH1dkG-WoahE Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:56:30.685922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2d2c614e07df4a29b2cd84c260fdc93a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 616a497708664cca8bf7cfe93cbfd01f Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.687238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '685facdf-09b2-422e-910a-4f139dbd14ca'} Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:56:30.687908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.689124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.692417 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-146bc379-90aa-462e-a15a-3fe4ef87ea8a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1547 microversion: 2.1 time: 0.204651 Aug 07 10:56:30.693212 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 175/349] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:30 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:30.694205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Returning 404 to user: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:56:30.696085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-83ff3a54-76aa-409f-a197-0f1c27dbcd3f tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "DELETE /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 404 len: 111 microversion: 2.1 time: 0.054014 Aug 07 10:56:30.697165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 175/350] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 10:56:30 2022] DELETE /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 10:56:30.711459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:30.713513 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] [instance: 685facdf-09b2-422e-910a-4f139dbd14ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:30.714279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:30.721578 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:30.723225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Searching by: {'deleted': False, 'project_id': '112b9a6f7ead454695e7efd26c0d845b'} {{(pid=117615) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 10:56:30.731868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.732511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.733165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.733592 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.734275 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.734417 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.735173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.735704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.735858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.736245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.736612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.737193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.743089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:30.765358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] HTTP exception thrown: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Request method failure captured: Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca HTTP/1.1 Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ngEZayRcvLKNz-fbJT1SfOZpIxNcwXnoG8pWa8Pg6IqWfJQbPoJFD4O4t9ZKsjfKu5DZVwSzZ9Jd-nvj9n50yN-QEfI7K1txto5p6zXKAWcNqlq6qWNYDDl509SVo9T35kLTAKQOoHjk76tHrnKPHhaURJofw4RPCfH1dkG-WoahE Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 10:56:30.787337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2d2c614e07df4a29b2cd84c260fdc93a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2d2c614e07df4a29b2cd84c260fdc93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 2d2c614e07df4a29b2cd84c260fdc93a Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058902480 Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 616a497708664cca8bf7cfe93cbfd01f Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-DeleteServersTestJSON-1058902480-project Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.788765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '685facdf-09b2-422e-910a-4f139dbd14ca'} Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:56:30.789667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. Aug 07 10:56:30.790796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 10:56:30.792050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] Returning 404 to user: Instance 685facdf-09b2-422e-910a-4f139dbd14ca could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:56:30.792050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-36f0f31a-27b5-4de8-8baa-adb07bd8d912 tempest-DeleteServersTestJSON-1058902480 tempest-DeleteServersTestJSON-1058902480-project] 10.222.0.25 "GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca" status: 404 len: 111 microversion: 2.1 time: 0.086922 Aug 07 10:56:30.792050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 176/351] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:30 2022] GET /compute/v2.1/servers/685facdf-09b2-422e-910a-4f139dbd14ca => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:56:30.870172 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:30.872206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:30.879998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.880840 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.881471 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.882207 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:30.882665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:30.883117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:30.888933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.multi_cell_list [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 10:56:31.042267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7f303c8-48b2-4e00-b12c-d9de3945fc4e tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.331824 Aug 07 10:56:31.043801 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 176/352] 10.222.0.25 () {58 vars in 1125 bytes} [Sun Aug 7 10:56:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:56:31.058302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:31.058703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:31.060152 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:31.072693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-029ed224-8357-485d-a2ff-aa01b1fcad99 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.206900 Aug 07 10:56:31.073359 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 177/353] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:30 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:31.076605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:31.079130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:31.079746 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:31.081337 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:31.082773 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:31.084861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:31.112225 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:31.114042 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:31.122666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:31.124827 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:31.125546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:31.127468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:31.129011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:31.129973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:31.377190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:31.385441 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6eb2490e-5d0f-4b70-b04a-c242931045a9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1547 microversion: 2.1 time: 0.334946 Aug 07 10:56:31.391068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 177/354] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:31 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1547 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:31.463480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:31.473363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-45fb1352-b1ee-4cd7-92ba-e864d2e24f20 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.365870 Aug 07 10:56:31.474708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 178/355] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:31 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:32.095514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:32.096662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:32.116900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:32.119699 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:32.120337 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:32.121075 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:32.121544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:32.122036 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:32.301505 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:32.304979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:32.311289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5ca71779-3270-48c1-bde1-51c703bbb37f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.221406 Aug 07 10:56:32.311865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 178/356] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:32 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:32.496138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:32.497303 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:32.508261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:32.508758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:32.509202 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:32.509912 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:32.510439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:32.510874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:32.672466 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:32.679946 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5b95a570-6fde-4c20-9c71-37b0793813b5 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.187783 Aug 07 10:56:32.680515 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 179/357] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:32 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:33.333510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:33.335108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:33.343256 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:33.344030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:33.344818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:33.345731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:33.346304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:33.346821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:33.587778 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:33.597924 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2fc581b0-8600-4e23-b239-e669043eef79 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.268358 Aug 07 10:56:33.613626 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 179/358] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:33 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:33.701580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:33.702192 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:33.713133 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:33.713609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:33.714036 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:33.714797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:33.715901 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:33.716319 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:33.862017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:33.872388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dfd44c45-d0c1-450f-8ce8-51127200f27a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.174615 Aug 07 10:56:33.876928 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 180/359] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:33 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:34.619598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:34.620178 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:34.627770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:34.628475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:34.628911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:34.629818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:34.630838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:34.631444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:34.895306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:34.898653 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:34.914619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:34.915443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:34.916247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:34.917233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:34.918188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:34.922680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:34.931404 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:34.932712 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8ca766b-bcd4-4aa0-8848-a2d306ae655a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.316858 Aug 07 10:56:34.935436 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 180/360] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:34 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:35.048682 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-c9512888-ecb4-4baf-a251-fb8fbaed46d2 req-b71bdb43-eb6f-46d0-9f33-d53d4966b9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3d6440-4150-4ad0-a18b-4032f8ac83dd", "name": "network-vif-plugged", "status": "completed", "tag": "099e595c-263d-4107-85f3-a8026451b3c9"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:35.064576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c9512888-ecb4-4baf-a251-fb8fbaed46d2 req-b71bdb43-eb6f-46d0-9f33-d53d4966b9ce service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:35.065172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c9512888-ecb4-4baf-a251-fb8fbaed46d2 req-b71bdb43-eb6f-46d0-9f33-d53d4966b9ce service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:35.065690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c9512888-ecb4-4baf-a251-fb8fbaed46d2 req-b71bdb43-eb6f-46d0-9f33-d53d4966b9ce service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:35.089777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-c9512888-ecb4-4baf-a251-fb8fbaed46d2 req-b71bdb43-eb6f-46d0-9f33-d53d4966b9ce service nova] Creating event network-vif-plugged:099e595c-263d-4107-85f3-a8026451b3c9 for instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd on hv-cinder-85032 Aug 07 10:56:35.110821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-c9512888-ecb4-4baf-a251-fb8fbaed46d2 req-b71bdb43-eb6f-46d0-9f33-d53d4966b9ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068069 Aug 07 10:56:35.115222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 181/361] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:56:35.170424 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:35.180898 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ac1e780e-81f1-4392-8257-aeed2089d92a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.291116 Aug 07 10:56:35.181869 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 181/362] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:34 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:35.960040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:35.960760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:35.966815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:35.967326 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:35.967758 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:35.968748 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:35.969199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:35.969622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:36.130721 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:36.139434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-532f9e83-1cdd-44e9-ade9-1249d69a1481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.183526 Aug 07 10:56:36.140017 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 182/363] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:35 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:36.201776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:36.202613 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:36.210684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:36.211312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:36.211822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:36.212609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:36.213139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:36.213735 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:36.311385 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6183409-7891-4060-aea6-835931632b0e"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:36.313840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:36.320122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:36.320624 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:36.321042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:36.321734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:36.322186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:36.322605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:36.600811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:36.609009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1c8b283c-86e2-4db7-9bc3-35a91990f0eb tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.411004 Aug 07 10:56:36.609836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 182/364] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:36 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:37.165934 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:37.166668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:37.175456 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:37.176097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:37.176772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:37.177786 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:37.178457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:37.179171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:37.506460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:37.515309 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-460666a9-c554-40d1-a7e2-ec29b4578be0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.353505 Aug 07 10:56:37.515889 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 183/365] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:37 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:37.611565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a504442e-0e52-41f3-b0be-53ffc54fc570 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.304944 Aug 07 10:56:37.612535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 183/366] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:56:36 2022] POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 194 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:56:37.629683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:37.630512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:37.639140 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:37.639931 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:37.648165 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:37.649907 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:37.650556 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:37.651517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:37.890965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:37.899130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-70ea2680-c717-4c70-baa9-6e20f0feadee tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.273196 Aug 07 10:56:37.913720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 184/367] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:37 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:38.540678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:38.541400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:38.551103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:38.551595 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:38.552026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:38.552719 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:38.553163 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:38.553745 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:38.730205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:38.748219 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1ec83f11-273e-4b7c-b818-8d9c052e5beb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.212442 Aug 07 10:56:38.749161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 184/368] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:38 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:38.921573 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:38.922945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:38.930883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:38.931759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:38.932415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:38.933320 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:38.934734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:38.936127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:39.098885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:39.108221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8e19af9f-de3e-45e9-8578-d6bff692a14a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.191015 Aug 07 10:56:39.122501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 185/369] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:38 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:39.773371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:39.776031 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:39.791635 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:39.797603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:39.798514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:39.799163 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:39.800122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:39.801315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:39.801896 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:39.966859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:39.977818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9c490dd3-eaec-4bce-822d-1dc0ddbcbc27 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.209685 Aug 07 10:56:39.978479 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 185/370] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:39 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:40.129248 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:40.129911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:40.137371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:40.138086 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:40.138695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:40.139575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:40.140204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:40.140782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:40.287468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:40.296983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-05619a46-979c-4c9e-b695-de7de98666f1 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.171337 Aug 07 10:56:40.297721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 186/371] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:40 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:41.002575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:41.003964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:41.011635 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:41.013228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:41.013715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:41.014515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:41.015583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:41.016189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:41.016813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:41.262784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:41.273883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a910266a-7f51-4eb8-b8e3-03c67c7a6b0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.275776 Aug 07 10:56:41.275119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 186/372] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:40 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:41.323530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:41.324842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:41.340836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:41.343324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:41.343963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:41.344874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:41.346585 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:41.347200 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:41.593213 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:41.600502 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-82512739-40f7-48a8-a99a-28d37b4ea1a6 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1314 microversion: 2.1 time: 0.282551 Aug 07 10:56:41.601319 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 187/373] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:41 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:41.716218 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1c136abb-536b-4f11-8322-9dbbcf6c44a5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: .version_select at 0x7fc5eda06f70>, body: {"keypair": {"name": "tempest-keypair-1941644687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIv4IMoEhAjhu+1+pimE2rfFykzvEBeecGccy6OhHydHs09+A0fHEcAHz6pzZfAZSNe2EQXpQEMwlNcOEFyuGSWY9AM50FvQP07BKcwNeKR/trc0WkJJtohMnKP6sgnDw=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:41.721570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:41.735668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-1c136abb-536b-4f11-8322-9dbbcf6c44a5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:56:41.739614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-1c136abb-536b-4f11-8322-9dbbcf6c44a5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:56:41.766207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1c136abb-536b-4f11-8322-9dbbcf6c44a5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180439 Aug 07 10:56:41.767182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 187/374] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 10:56:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:42.298215 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:42.299370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:42.309947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.310702 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.311185 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.311907 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.312367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.313080 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.546517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:42.556123 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-21cdcacd-de96-4d07-9894-38055e9b1b90 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1500 microversion: 2.1 time: 0.264325 Aug 07 10:56:42.556953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 188/375] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:42 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:42.577858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "679aeca2-fa85-47a2-8ae8-ad4e68852884"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:42.580929 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:42.593174 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.595251 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.595715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.596445 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.596912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.597341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.622742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:42.623699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:42.630858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] HTTP exception thrown: Cannot 'attach_volume' instance e465ec9d-f167-4410-b5dd-95c885e888a4 while it is in vm_state rescued Aug 07 10:56:42.631310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Request method failure captured: Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4/os-volume_attachments HTTP/1.1 Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 74 Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nVmZDqBLrDKaFPcpgAj1m59o29KiJgkU6QeMiRKYvuG9-HKcbDZxNkXe76Ofs3N4KQZo7-rYjxd-AAuB1e9uveaUp_uErWexkSZnBV-MiPM-RB2A0a0n43oyr-LtZIoAqjTuEE7K1-qP7s_rvHIN5ja6d9GrzIlpu9G6EPnUpBEd4 Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:56:42.633310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6ca365836428198f2d20fd9829feb", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c3a12c3144844d32812e010550bb0921 Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {"volumeAttachment": {"volumeId": "679aeca2-fa85-47a2-8ae8-ad4e68852884"}} Aug 07 10:56:42.634568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Cannot 'attach_volume' instance e465ec9d-f167-4410-b5dd-95c885e888a4 while it is in vm_state rescued Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'server_id': 'e465ec9d-f167-4410-b5dd-95c885e888a4', 'body': {'volumeAttachment': {'volumeId': '679aeca2-fa85-47a2-8ae8-ad4e68852884'}}} Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e465ec9d-f167-4410-b5dd-95c885e888a4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:56:42.635336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e465ec9d-f167-4410-b5dd-95c885e888a4 while it is in vm_state rescued Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:42.636480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:42.637581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:56:42.637581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:56:42.637581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e465ec9d-f167-4410-b5dd-95c885e888a4 while it is in vm_state rescued Aug 07 10:56:42.637581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:42.637581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Returning 409 to user: Cannot 'attach_volume' instance e465ec9d-f167-4410-b5dd-95c885e888a4 while it is in vm_state rescued {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:56:42.637581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ae9c1b22-a855-4d67-b3ed-9e3637cb97ec tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061825 Aug 07 10:56:42.637957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.637957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.637957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.637957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.638253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.640418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 188/376] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:56:42 2022] POST /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 10:56:42.645653 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:42.646548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:42.653351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.654193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.654881 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.656337 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.657024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.657667 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.755249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a74d8805-08e9-4671-a1a3-7972ed389c6b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4/action" status: 202 len: 0 microversion: 2.1 time: 0.113330 Aug 07 10:56:42.756264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 189/377] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:56:42 2022] POST /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:56:42.773888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:42.774788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:42.782323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.782877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.783663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.785216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:42.785847 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:42.786436 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:42.981815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:42.989747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d663d37f-3727-4dc5-ad15-07ea733b3185 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1464 microversion: 2.1 time: 0.371868 Aug 07 10:56:43.007338 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 189/378] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:42 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:43.046011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:43.046507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:43.052349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:43.053150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:43.053582 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:43.054501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:43.054891 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:43.055513 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:43.083422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 10:56:43.128591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:43.151182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-03ec2821-c752-4881-a1ef-72af56e54b1d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1508 microversion: 2.1 time: 0.381399 Aug 07 10:56:43.156324 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 190/379] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:42 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:43.208549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9cb31fce-53ae-4f50-bdeb-39c9d1020370 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 204 len: 0 microversion: 2.1 time: 0.167109 Aug 07 10:56:43.209684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 190/380] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 10:56:43 2022] DELETE /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 10:56:43.230866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:43.231777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:43.264615 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:43.267763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:43.268549 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:43.269513 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:43.270481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:43.271181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:43.601612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:43.610242 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d058286-a2dc-408a-8ed5-ca65734485d3 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1470 microversion: 2.1 time: 0.396053 Aug 07 10:56:43.611148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 191/381] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:43 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1470 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:43.966078 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-700171648", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a58cdcc4-38d5-4381-93af-404135fb0ce7"}], "security_groups": [{"name": "tempest-securitygroup--1010349517"}], "key_name": "tempest-keypair-1941644687", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:44.085098 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] validate_networks() for [('a58cdcc4-38d5-4381-93af-404135fb0ce7', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:56:44.189860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:44.190471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:44.199445 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:44.200237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:44.200678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:44.202984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:44.203408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:44.203836 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:44.477415 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:44.489640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-99b770c6-a8f5-4e6b-a851-f4d7048440f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1508 microversion: 2.1 time: 0.303170 Aug 07 10:56:44.490789 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 192/382] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:44 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:44.626173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:56:44.626599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:56:44.627155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:56:44.627573 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:56:44.627997 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:56:44.634757 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:44.638468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:44.638969 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:44.639801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:44.640508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:44.641618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:44.642245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:44.643601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:44.648023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:44.648873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:44.649523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:44.650470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:44.651172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:44.652108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:44.664621 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:56:44.675459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:56:44.695890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:56:44.699374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:56:44.762462 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-64592e53-0c46-4e77-bc78-8f6f1ba0ef13 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800914 Aug 07 10:56:44.763553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 191/383] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:56:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:56:44.775855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bf61f1fd-dcc1-4f86-b17b-d16084a59670 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:44.777027 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bf61f1fd-dcc1-4f86-b17b-d16084a59670 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:44.804048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:44.894895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bf61f1fd-dcc1-4f86-b17b-d16084a59670 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:44.910156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bf61f1fd-dcc1-4f86-b17b-d16084a59670 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1241 microversion: 2.1 time: 0.137359 Aug 07 10:56:44.913293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:44.922326 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-09e6d5ed-505a-4e62-898b-7b84bf1b793f tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1470 microversion: 2.1 time: 0.292295 Aug 07 10:56:44.923472 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 193/384] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:44 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:44.927227 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 192/385] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:44 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:45.510984 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:45.513142 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:45.519816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:45.520398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:45.520928 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:45.521822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:45.522287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:45.522713 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:45.539122 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:45.681530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:45.694066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8a6eded6-e6b1-4a27-8782-3e4e42ee72cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1508 microversion: 2.1 time: 0.187108 Aug 07 10:56:45.695102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 193/386] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:45 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:45.931307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:45.933148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:45.943491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:45.947802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:45.951276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:45.951459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:45.955821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:45.956798 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:45.957456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:45.960784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:45.974329 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:45.974965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:45.977973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:45.978812 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:45.983461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:45.984153 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:46.066618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:46.083220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-951e07e0-04fe-40d2-98f4-8cf87c4829b2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1245 microversion: 2.1 time: 0.149958 Aug 07 10:56:46.084444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 194/387] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:45 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1245 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:46.194107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:46.208796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e7f1c17a-9dbf-4f51-b44f-ff8680b6fc88 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1470 microversion: 2.1 time: 0.268706 Aug 07 10:56:46.209586 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 194/388] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:45 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:46.488048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:46.488652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:46.495893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:46.496681 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:46.497290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:46.498195 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:46.498658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:46.499396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:46.507531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:46.644571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:46.657630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c4739f56-7bc3-452c-8cca-4e637122ce28 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1593 microversion: 2.1 time: 0.173041 Aug 07 10:56:46.657985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 195/389] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:46 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:46.717313 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:46.718873 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:46.726255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:46.731744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:46.732298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:46.733477 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:46.733960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:46.734390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:47.057609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:47.067997 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5116026c-aaf6-4fc0-a790-bf5f333303e2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1508 microversion: 2.1 time: 0.355848 Aug 07 10:56:47.070523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 195/390] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:46 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:47.104061 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:47.104678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:47.112620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:47.113336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:47.113768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:47.114487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:47.114976 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:47.115431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:47.213175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:47.221818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a73bfae4-6495-4b81-bafb-372f15ada539 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1299 microversion: 2.1 time: 0.121366 Aug 07 10:56:47.222683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 196/391] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:47 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:47.242086 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:47.242700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:47.254233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:47.254765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:47.255205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:47.255921 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:47.256378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:47.256803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:47.452432 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:47.466611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-93472e3f-4161-4d46-8aed-5f5f448adfd8 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1428 microversion: 2.1 time: 0.228206 Aug 07 10:56:47.479030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 196/392] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:47 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1428 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:47.490477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-9e072973-a400-4b66-826f-a82f93dd0d79 req-6dd2d80d-a000-46dc-b29b-63439ec88a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c3d6440-4150-4ad0-a18b-4032f8ac83dd", "name": "network-vif-deleted", "tag": "099e595c-263d-4107-85f3-a8026451b3c9"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:47.500999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9e072973-a400-4b66-826f-a82f93dd0d79 req-6dd2d80d-a000-46dc-b29b-63439ec88a46 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:47.501477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9e072973-a400-4b66-826f-a82f93dd0d79 req-6dd2d80d-a000-46dc-b29b-63439ec88a46 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:47.501909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9e072973-a400-4b66-826f-a82f93dd0d79 req-6dd2d80d-a000-46dc-b29b-63439ec88a46 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:47.551684 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-9e072973-a400-4b66-826f-a82f93dd0d79 req-6dd2d80d-a000-46dc-b29b-63439ec88a46 service nova] Creating event network-vif-deleted:099e595c-263d-4107-85f3-a8026451b3c9 for instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd on hv-cinder-85032 Aug 07 10:56:47.571096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-9e072973-a400-4b66-826f-a82f93dd0d79 req-6dd2d80d-a000-46dc-b29b-63439ec88a46 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084296 Aug 07 10:56:47.572011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 197/393] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:48.093821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:48.095292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:48.103210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:48.103954 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:48.104576 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:48.105470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:48.105930 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:48.106394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:48.250571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:48.251422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:48.271188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:48.271929 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:48.273622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:48.274354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:48.274820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:48.275279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:48.391693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:48.404172 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-67e325b5-a50a-4f14-9ceb-c1cf93d92c4d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1508 microversion: 2.1 time: 0.314098 Aug 07 10:56:48.407251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 197/394] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:48 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:48.479391 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:48.488582 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:48.492548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:48.503816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0318a48f-bdcf-4659-b7a2-a7232d0715cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.264181 Aug 07 10:56:48.504403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 198/395] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:48 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:48.518908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:48.519088 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:48.519475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:48.520197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:48.520655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:48.521111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:48.554324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:48.554750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:48.556028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:48.556028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lazy-loading 'fault' on Instance uuid 2c3d6440-4150-4ad0-a18b-4032f8ac83dd {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:56:48.606617 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:48.614410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d841901c-6951-45dc-9466-22f30301e68a tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1304 microversion: 2.1 time: 0.129622 Aug 07 10:56:48.615013 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 198/396] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:48 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:49.431167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:49.431786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:49.443456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.444243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.444686 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.445404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.445857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.447056 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.524519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:49.525891 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:49.534293 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.535469 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.536512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.537653 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.538516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.539167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.625418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:49.634082 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5fbbc1ac-c126-4271-ab9f-1da55c51756e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1508 microversion: 2.1 time: 0.206953 Aug 07 10:56:49.636661 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 199/397] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:49 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:49.648509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:49.649628 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:49.663074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.663834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.664465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.665663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.666459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.667124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.712212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.712919 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.713547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.714204 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lazy-loading 'fault' on Instance uuid 2c3d6440-4150-4ad0-a18b-4032f8ac83dd {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:56:49.782181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:49.795239 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fd490f09-8735-4798-be42-2b83a32d0aa9 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1304 microversion: 2.1 time: 0.156336 Aug 07 10:56:49.796481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 200/398] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:49 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:49.803009 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-d5bde8f3-48da-4de6-9a52-5ba49ea0e2ba req-d040732f-eac4-4574-8359-31ce17619604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423c8be-dde1-4173-8d7b-cf9be55ee8ca", "tag": "3cd59e35-98cf-47ca-bef7-d9000d1de278"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:49.809869 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:49.813933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d5bde8f3-48da-4de6-9a52-5ba49ea0e2ba req-d040732f-eac4-4574-8359-31ce17619604 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:49.814541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d5bde8f3-48da-4de6-9a52-5ba49ea0e2ba req-d040732f-eac4-4574-8359-31ce17619604 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:49.815210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d5bde8f3-48da-4de6-9a52-5ba49ea0e2ba req-d040732f-eac4-4574-8359-31ce17619604 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:49.818689 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-41627d6b-d41f-4283-93bf-d854535f3182 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.297912 Aug 07 10:56:49.833693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-d5bde8f3-48da-4de6-9a52-5ba49ea0e2ba req-d040732f-eac4-4574-8359-31ce17619604 service nova] Creating event network-changed:3cd59e35-98cf-47ca-bef7-d9000d1de278 for instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca on hv-cinder-85032 Aug 07 10:56:49.834416 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 199/399] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:49 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:49.835157 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-d5bde8f3-48da-4de6-9a52-5ba49ea0e2ba req-d040732f-eac4-4574-8359-31ce17619604 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037039 Aug 07 10:56:49.835894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 201/400] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:50.430736 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-166872206"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:50.432057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:50.440106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:50.440847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:50.441721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:50.442740 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:50.443309 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:50.443728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:50.660870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:50.661515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:50.668006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:50.668671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:50.669112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:50.669826 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:50.670883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:50.671352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:50.704959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.network.security_group_api [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Adding security group e4a409ce-9bed-4029-838e-8b0c612ef18f to port 3cd59e35-98cf-47ca-bef7-d9000d1de278 Aug 07 10:56:51.061248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:51.070965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1bd1e943-7ac7-4ad9-8e70-4100483c7993 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1514 microversion: 2.1 time: 0.416034 Aug 07 10:56:51.084549 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 202/401] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:50 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1514 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:51.115640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:51.123400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:51.139677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.140532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.143483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.144573 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.145216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.147883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.226050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.226478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.227294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.227906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lazy-loading 'fault' on Instance uuid 2c3d6440-4150-4ad0-a18b-4032f8ac83dd {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:56:51.353065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb2182f9b614007b61823075835fe33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f306584e65048f98a4128cafc1b210c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:51.362358 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8a4c8cfd-5a06-401c-862b-be65a4ef6df7 tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 200 len: 1304 microversion: 2.1 time: 0.276162 Aug 07 10:56:51.364102 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 203/402] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:51 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 1304 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:51.374892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:51.377309 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:51.393143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.393911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.394360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.395116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.395731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.396378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.597759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-19398f86-aac8-462f-b1bd-b18c4ffcc8b0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/action" status: 202 len: 0 microversion: 2.1 time: 1.170467 Aug 07 10:56:51.601809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 200/403] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:56:50 2022] POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/action => generated 0 bytes in 1176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:56:51.606887 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5d0e823d-0f03-44b0-b7fe-faecde04cd16 req-77481e26-ae93-4bcf-9925-3214506be424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bde61e-a4b4-4a6c-87dc-23390b24133c", "tag": "608cc7ba-ed02-42a5-80dd-933bc7090500"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:51.617559 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5d0e823d-0f03-44b0-b7fe-faecde04cd16 req-77481e26-ae93-4bcf-9925-3214506be424 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.637594 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5d0e823d-0f03-44b0-b7fe-faecde04cd16 req-77481e26-ae93-4bcf-9925-3214506be424 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.638512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5d0e823d-0f03-44b0-b7fe-faecde04cd16 req-77481e26-ae93-4bcf-9925-3214506be424 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.651483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5d0e823d-0f03-44b0-b7fe-faecde04cd16 req-77481e26-ae93-4bcf-9925-3214506be424 service nova] Creating event network-changed:608cc7ba-ed02-42a5-80dd-933bc7090500 for instance 71bde61e-a4b4-4a6c-87dc-23390b24133c on hv-cinder-85032 Aug 07 10:56:51.657918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5d0e823d-0f03-44b0-b7fe-faecde04cd16 req-77481e26-ae93-4bcf-9925-3214506be424 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054680 Aug 07 10:56:51.659976 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 201/404] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:51.668372 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:51.669583 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:51.676875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.677368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.677804 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.678508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:51.679178 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:51.679589 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:51.705915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:51.719108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-86202704-153b-4aad-96fc-1a550a019236 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.352122 Aug 07 10:56:51.720308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 204/405] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:51 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:51.967528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:51.981853 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f510bbf-6cb4-4946-802c-f022285cfca8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1639 microversion: 2.1 time: 0.319751 Aug 07 10:56:51.982585 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 202/406] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:51 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1639 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:52.393013 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:52.394055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] [instance: 2c3d6440-4150-4ad0-a18b-4032f8ac83dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:52.395718 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:52.402017 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:52.402753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:52.402981 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:52.403870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:52.404337 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:52.404764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:52.428650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] HTTP exception thrown: Instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd could not be found. Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Request method failure captured: Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd HTTP/1.1 Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75o_uHAho1_tTN4yu_56zxGvINeN3CVpHALorGjTkSqSV8b05qs9tcnjTUIEg4BA6HyXe3wZpljIQgFSdsIwU-Nk7MjVCXAThKrDiOOwDDDNn6T8geIRmnGze-_cc-u7pYAfa-8iorm3ZsC34Pu88EZmFtwTrvtoS3_FvCiAOnSxraw Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 2f306584e65048f98a4128cafc1b210c Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-2054504017 Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:56:52.430057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f306584e65048f98a4128cafc1b210c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f306584e65048f98a4128cafc1b210c", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f306584e65048f98a4128cafc1b210c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f306584e65048f98a4128cafc1b210c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-2054504017 Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 2f306584e65048f98a4128cafc1b210c Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-2054504017 Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-2054504017-project Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: aeb2182f9b614007b61823075835fe33 Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-2054504017-project Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd could not be found. Aug 07 10:56:52.431304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '2c3d6440-4150-4ad0-a18b-4032f8ac83dd'} Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd could not be found. Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:56:52.432024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd could not be found. Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd could not be found. Aug 07 10:56:52.434177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:56:52.435408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] Returning 404 to user: Instance 2c3d6440-4150-4ad0-a18b-4032f8ac83dd could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:56:52.435408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-92850113-d0b7-4d03-b6fb-8470d42a1adc tempest-VolumesNegativeTest-2054504017 tempest-VolumesNegativeTest-2054504017-project] 10.222.0.25 "GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd" status: 404 len: 111 microversion: 2.1 time: 0.042393 Aug 07 10:56:52.435408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 205/407] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:52 2022] GET /compute/v2.1/servers/2c3d6440-4150-4ad0-a18b-4032f8ac83dd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:56:52.625383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f9a8461-3c04-4588-9f17-2dbc303c2341 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'create', calling method: .version_select at 0x7fc5edc32f70>, body: {"keypair": {"name": "tempest-keypair-1305991211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlR38fRjnfytisZ4GGKVkcruxBIczEt9b+zVhhDRCcultRHFnYlid3H5DfJXpOHQZc9FYYh026AlAfZsW1iKm+pcWF4pDE25/UEUpHtHbHUwy3qeDs0sQ3yQkG5s+BQZw=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:52.645199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2f9a8461-3c04-4588-9f17-2dbc303c2341 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for project 9df6ca365836428198f2d20fd9829feb. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:56:52.649886 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2f9a8461-3c04-4588-9f17-2dbc303c2341 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for user c3a12c3144844d32812e010550bb0921 and project 9df6ca365836428198f2d20fd9829feb. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:56:52.678276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f9a8461-3c04-4588-9f17-2dbc303c2341 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057889 Aug 07 10:56:52.679440 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 203/408] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 10:56:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:52.741185 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:52.743330 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:52.752789 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:52.753875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:52.754625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:52.755585 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:52.756255 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:52.756834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:52.923689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:52.932702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bd3d0578-c0fe-4345-9c93-dad3f9253bfa tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.196091 Aug 07 10:56:52.933310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 206/409] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:52 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:53.678419 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-41b3fc3d-b669-473e-9b80-8f0252d9da64 req-76dc25ca-fc9e-414e-9994-f3200abd4ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423c8be-dde1-4173-8d7b-cf9be55ee8ca", "tag": "3cd59e35-98cf-47ca-bef7-d9000d1de278"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:53.689623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-41b3fc3d-b669-473e-9b80-8f0252d9da64 req-76dc25ca-fc9e-414e-9994-f3200abd4ec8 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:53.690621 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-41b3fc3d-b669-473e-9b80-8f0252d9da64 req-76dc25ca-fc9e-414e-9994-f3200abd4ec8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:53.691413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-41b3fc3d-b669-473e-9b80-8f0252d9da64 req-76dc25ca-fc9e-414e-9994-f3200abd4ec8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:53.704744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-41b3fc3d-b669-473e-9b80-8f0252d9da64 req-76dc25ca-fc9e-414e-9994-f3200abd4ec8 service nova] Creating event network-changed:3cd59e35-98cf-47ca-bef7-d9000d1de278 for instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca on hv-cinder-85032 Aug 07 10:56:53.710749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-41b3fc3d-b669-473e-9b80-8f0252d9da64 req-76dc25ca-fc9e-414e-9994-f3200abd4ec8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035913 Aug 07 10:56:53.717196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 204/410] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:56:53.953733 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:53.954634 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:53.967914 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:53.968786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:53.969459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:53.972455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:53.975050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:53.975611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:54.212369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:54.215411 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1309659036", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "506b3088-03b1-4569-bcdb-92d73b15b685"}], "security_groups": [{"name": "tempest-securitygroup--1160275027"}], "key_name": "tempest-keypair-1305991211", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:56:54.224124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d4da0913-f741-4e97-9648-1be81fa19ebf tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.275292 Aug 07 10:56:54.239048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 207/411] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:53 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:54.355855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] validate_networks() for [('506b3088-03b1-4569-bcdb-92d73b15b685', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:56:54.655141 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:54.772028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:56:54.772573 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:56:54.773054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:56:54.773539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:56:54.773982 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:56:54.783565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:54.783978 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:54.784406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:54.785114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:54.785564 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:54.785984 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:54.802384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for project 9df6ca365836428198f2d20fd9829feb. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:56:54.806286 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Getting quotas for user c3a12c3144844d32812e010550bb0921 and project 9df6ca365836428198f2d20fd9829feb. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:56:54.817693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:56:54.820048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:56:54.867768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aa072741-d3f0-4385-8b3d-7af398cb1afa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.657885 Aug 07 10:56:54.868617 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 205/412] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:56:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:56:54.879049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8376ed07-6846-43c8-a6e3-ede1945f787a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:54.879651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8376ed07-6846-43c8-a6e3-ede1945f787a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:54.935481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8376ed07-6846-43c8-a6e3-ede1945f787a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:54.942896 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8376ed07-6846-43c8-a6e3-ede1945f787a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1246 microversion: 2.1 time: 0.067644 Aug 07 10:56:54.943993 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 208/413] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:54 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:55.254470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:55.255115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:55.261371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:55.261867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:55.262471 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:55.263328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:55.263922 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:55.264449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:55.429453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:55.438151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-636c3dbf-0775-4c69-9142-428253922a68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.187447 Aug 07 10:56:55.438710 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 206/414] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:55 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:55.964129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:55.965516 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:55.971702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:55.972185 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:55.972615 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:55.973304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:55.973788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:55.974211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:56.035451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:56.043409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-85381df2-f43c-4445-aec4-84a70e6460b2 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1250 microversion: 2.1 time: 0.083053 Aug 07 10:56:56.043967 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 209/415] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:55 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:56.459139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:56.459759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:56.466753 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:56.467258 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:56.467696 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:56.468386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:56.468843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:56.469267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:56.598660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:56.606845 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-10ece044-50d5-4ba0-b16c-c98b7b09870d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.151599 Aug 07 10:56:56.607433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 207/416] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:56 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:57.064215 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:57.064852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:57.071496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:57.071967 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:57.072396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:57.073074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:57.073594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:57.074574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:57.136045 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:57.144435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-02dae42d-4b8a-442e-8a68-aff370e742d5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1250 microversion: 2.1 time: 0.083998 Aug 07 10:56:57.145001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 210/417] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:57 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:56:57.627814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:57.628486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:57.635393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:57.635870 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:57.636379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:57.637325 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:57.637780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:57.638196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:57.765108 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:57.772371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-07761758-b961-4e56-84c7-88b14bd1ff07 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.148585 Aug 07 10:56:57.772923 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 208/418] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:57 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:58.165134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:58.165857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:58.173919 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:58.174445 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:58.174885 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:58.175619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:58.176079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:58.176505 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:58.242695 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:58.251406 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-95bdb9d5-1c30-4e35-a515-c50b61c55476 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1250 microversion: 2.1 time: 0.090055 Aug 07 10:56:58.252380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 211/419] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:58 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1250 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:58.792887 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:58.793506 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:58.799866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:58.800341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:58.800766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:58.801446 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:58.801893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:58.802308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:58.930237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:58.937682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b252bc05-893f-4775-8129-98362565e398 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.149153 Aug 07 10:56:58.938240 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 209/420] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:58 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:59.272139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:59.272820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:59.279108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:59.279473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:59.279901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:59.280608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:59.281058 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:59.281478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:59.341415 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:56:59.348665 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-efd88e7d-b45b-4589-9032-840540c66ee8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1250 microversion: 2.1 time: 0.080550 Aug 07 10:56:59.349226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 212/421] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:59 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:56:59.957630 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:56:59.958173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:56:59.965200 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:59.965681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:59.966117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:56:59.966814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:56:59.967305 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:56:59.967731 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:00.094673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:00.102054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1f9d4550-8f6c-47d3-ab47-95c63a5bce77 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.148375 Aug 07 10:57:00.102614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 210/422] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:56:59 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:00.369345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:00.369957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:00.376360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:00.376844 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:00.377281 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:00.377971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:00.378430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:00.378854 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:00.441920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:00.450366 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-639ccaf8-d45c-4831-acc2-1bc29deb2949 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1250 microversion: 2.1 time: 0.084769 Aug 07 10:57:00.450949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 213/423] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:00 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:01.123742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:01.124350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:01.130739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:01.131265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:01.131681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:01.132358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:01.132815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:01.133232 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:01.460868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:01.469474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-278bfcae-0245-4de0-a866-571701ce88ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.350152 Aug 07 10:57:01.470049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 211/424] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:01 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:01.471249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:01.471923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:01.478329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:01.478802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:01.479261 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:01.479948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:01.480422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:01.480837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:01.485092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:01.541496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:01.548902 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5761c9aa-cd24-4d57-9787-4db596c9975a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1250 microversion: 2.1 time: 0.081424 Aug 07 10:57:01.549498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 214/425] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:01 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:02.493939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:02.495560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:02.506913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:02.507777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:02.508444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:02.509243 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:02.510018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:02.510722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:02.583899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:02.584699 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:02.598283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:02.600897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:02.603492 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:02.604364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:02.604894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:02.605318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:02.760693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:02.771232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a36be067-f98d-4015-9f66-f9093034ee9f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1306 microversion: 2.1 time: 0.205355 Aug 07 10:57:02.772081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 215/426] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:02 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1306 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:02.848417 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:02.870135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-71e68369-47bb-4fb5-a5f8-abcd843bf595 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.381426 Aug 07 10:57:02.871974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 212/427] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:02 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:03.508824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-8ab8ec56-72fb-408b-be03-5660019d6186 req-73058af7-75d7-4e73-a14e-b5950088a624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bde61e-a4b4-4a6c-87dc-23390b24133c", "name": "network-vif-plugged", "status": "completed", "tag": "608cc7ba-ed02-42a5-80dd-933bc7090500"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:03.521930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8ab8ec56-72fb-408b-be03-5660019d6186 req-73058af7-75d7-4e73-a14e-b5950088a624 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:03.522474 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8ab8ec56-72fb-408b-be03-5660019d6186 req-73058af7-75d7-4e73-a14e-b5950088a624 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:03.523240 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8ab8ec56-72fb-408b-be03-5660019d6186 req-73058af7-75d7-4e73-a14e-b5950088a624 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:03.536770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-8ab8ec56-72fb-408b-be03-5660019d6186 req-73058af7-75d7-4e73-a14e-b5950088a624 service nova] Creating event network-vif-plugged:608cc7ba-ed02-42a5-80dd-933bc7090500 for instance 71bde61e-a4b4-4a6c-87dc-23390b24133c on hv-cinder-85032 Aug 07 10:57:03.542444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-8ab8ec56-72fb-408b-be03-5660019d6186 req-73058af7-75d7-4e73-a14e-b5950088a624 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038067 Aug 07 10:57:03.543059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 216/428] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:57:03.795666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:03.796421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:03.804811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:03.805307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:03.805744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:03.806624 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:03.807254 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:03.809566 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:03.812533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:03.900649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:03.901478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:03.909025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:03.910725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:03.911285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:03.912705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:03.914771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:03.924785 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:04.020273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:04.030264 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9b40403a-510e-491e-8ed8-4c6dfa74855e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.239970 Aug 07 10:57:04.043188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 213/429] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:03 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:04.084929 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:04.093027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3003eaa0-95d4-456a-bfbe-25f4a4b3ff16 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.196497 Aug 07 10:57:04.093879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 217/430] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:03 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:04.242502 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-8fa31a0f-27af-410d-a0d0-768bf3e212b7 req-23bb56cd-54ab-479b-b6e6-99e9578e80a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf03e0d-d4df-471c-a17e-db0ab8dbbc1f", "tag": "8f5e1d77-61de-4709-a023-e0d9df750ea5"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:04.251890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8fa31a0f-27af-410d-a0d0-768bf3e212b7 req-23bb56cd-54ab-479b-b6e6-99e9578e80a5 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:04.252359 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8fa31a0f-27af-410d-a0d0-768bf3e212b7 req-23bb56cd-54ab-479b-b6e6-99e9578e80a5 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:04.252777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8fa31a0f-27af-410d-a0d0-768bf3e212b7 req-23bb56cd-54ab-479b-b6e6-99e9578e80a5 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:04.263973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-8fa31a0f-27af-410d-a0d0-768bf3e212b7 req-23bb56cd-54ab-479b-b6e6-99e9578e80a5 service nova] Creating event network-changed:8f5e1d77-61de-4709-a023-e0d9df750ea5 for instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f on hv-cinder-85032 Aug 07 10:57:04.268689 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-8fa31a0f-27af-410d-a0d0-768bf3e212b7 req-23bb56cd-54ab-479b-b6e6-99e9578e80a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029794 Aug 07 10:57:04.269294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 214/431] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:05.053045 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:05.053847 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:05.056369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:05.062241 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:05.062903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:05.063357 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:05.064045 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:05.064497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:05.064916 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:05.110746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:05.112148 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=18 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:05.116256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:05.116966 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:05.124149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:05.124642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:05.125061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:05.125752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:05.126241 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:05.126667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:05.255808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:05.263570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dba355ce-c58d-4e9f-a450-055164c6ee06 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.215105 Aug 07 10:57:05.264152 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 218/432] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:05 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:05.306540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:05.314601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-01bdcf2a-7c8a-4694-bb14-0175e528d262 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1367 microversion: 2.1 time: 0.204799 Aug 07 10:57:05.315208 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 215/433] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:05 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:05.664359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-385026566", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1322765706", "security_groups": [{"name": "tempest-secgroup-smoke-2006906105"}], "networks": [{"uuid": "6b8e14fc-5364-4c3c-b731-6e2722f3d73c"}], "block_device_mapping_v2": [{"uuid": "922cea9d-ffef-481f-88b8-80d81993ba11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:05.778778 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] validate_networks() for [('6b8e14fc-5364-4c3c-b731-6e2722f3d73c', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:57:06.157316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:57:06.157800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:57:06.158213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:57:06.158619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:57:06.159069 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:57:06.168806 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.169293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.169863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.170678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.171279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.171720 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.189440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Getting quotas for project 758665157bfd4f7fa6219f898a9c99a2. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:57:06.193443 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Getting quotas for user 8cb8ad1bff7f4e439cefdf6f0ef9a2d0 and project 758665157bfd4f7fa6219f898a9c99a2. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:57:06.251580 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:57:06.253632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='922cea9d-ffef-481f-88b8-80d81993ba11',volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:57:06.284799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:06.285528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:06.292197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.293117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.293570 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.294275 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.294734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.295188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.401742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c10a9638-6f64-4221-a095-fd4ba52c322b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741269 Aug 07 10:57:06.408363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 219/434] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:57:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:57:06.408363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:06.408363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:06.426669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.427475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.427982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.428766 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.429937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.430377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.475614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:06.495090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a37cad47-aafa-43b7-91b5-151e80d3fef1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.213881 Aug 07 10:57:06.496452 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 216/435] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:06 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:06.514004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e176b39f-697a-4105-8fc2-8189babf1c6e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:06.514628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e176b39f-697a-4105-8fc2-8189babf1c6e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:06.579517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e176b39f-697a-4105-8fc2-8189babf1c6e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:06.586968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e176b39f-697a-4105-8fc2-8189babf1c6e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1088 microversion: 2.1 time: 0.076947 Aug 07 10:57:06.587525 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 217/436] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:06 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:06.635403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:06.644115 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1b3469eb-af0e-48d7-8e21-b29335907cb9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1557 microversion: 2.1 time: 0.240277 Aug 07 10:57:06.658959 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 220/437] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:06 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1557 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:06.666760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:06.668346 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:06.676753 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.677629 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.678356 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.679288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:06.679896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:06.680773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:06.828709 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a77c8473-5904-4be7-a8e5-47f1ca2cb80f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166919 Aug 07 10:57:06.829454 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 218/438] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 10:57:06 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:07.521079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:07.522230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:07.526186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:07.533971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:07.534451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:07.534880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:07.535606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:07.536054 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:07.536467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:07.611217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:07.612460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:07.623680 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:07.624176 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:07.624616 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:07.625399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:07.625876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:07.626287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:07.828712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:07.836150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-82760ac5-a403-47a5-a9b3-1bd4084136f0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1138 microversion: 2.1 time: 0.231496 Aug 07 10:57:07.836729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 219/439] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:07 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1138 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:07.984325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:07.992668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-13ae13f2-b57f-4c9e-a502-91af812c4304 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.479110 Aug 07 10:57:07.993341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 221/440] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:07 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:08.339828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2b688b12-18ac-4af1-afdb-a900b6775507 req-090cf2ba-e558-4521-abb6-b1c7d9812227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bde61e-a4b4-4a6c-87dc-23390b24133c", "tag": "608cc7ba-ed02-42a5-80dd-933bc7090500"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:08.349680 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2b688b12-18ac-4af1-afdb-a900b6775507 req-090cf2ba-e558-4521-abb6-b1c7d9812227 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:08.350374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2b688b12-18ac-4af1-afdb-a900b6775507 req-090cf2ba-e558-4521-abb6-b1c7d9812227 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:08.350790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2b688b12-18ac-4af1-afdb-a900b6775507 req-090cf2ba-e558-4521-abb6-b1c7d9812227 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:08.365204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2b688b12-18ac-4af1-afdb-a900b6775507 req-090cf2ba-e558-4521-abb6-b1c7d9812227 service nova] Creating event network-changed:608cc7ba-ed02-42a5-80dd-933bc7090500 for instance 71bde61e-a4b4-4a6c-87dc-23390b24133c on hv-cinder-85032 Aug 07 10:57:08.371096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2b688b12-18ac-4af1-afdb-a900b6775507 req-090cf2ba-e558-4521-abb6-b1c7d9812227 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Aug 07 10:57:08.371916 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 220/441] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:08.857427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:08.858293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:08.864960 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:08.866103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:08.866467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:08.867311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:08.867671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:08.868103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:08.935579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:08.943128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-53ef48b6-e4ac-4ad0-94c3-1be79944ec8e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1138 microversion: 2.1 time: 0.090057 Aug 07 10:57:08.943701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 222/442] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:08 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:09.014645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:09.015425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:09.022587 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:09.023104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:09.023625 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:09.024376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:09.025076 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:09.025537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:09.170795 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:09.180399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-269d0979-f69c-4d28-ac97-3f83349ee99e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.170358 Aug 07 10:57:09.180989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 221/443] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:09 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:09.964866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:09.965665 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:09.973488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:09.974023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:09.974754 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:09.975594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:09.976169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:09.976665 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:10.048301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:10.056367 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-da23c442-8926-4c37-b2f2-3fa8f7fb9b90 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1130 microversion: 2.1 time: 0.095894 Aug 07 10:57:10.057007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 223/444] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:09 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1130 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:10.201854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:10.202504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:10.210016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:10.210512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:10.210975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:10.211684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:10.212135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:10.212553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:10.354447 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:10.363053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-92c29db2-3247-419f-8b2c-9b664637db0b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.165987 Aug 07 10:57:10.363736 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 222/445] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:10 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:11.078561 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:11.079268 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:11.086213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:11.086705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:11.087195 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:11.087906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:11.088423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:11.089407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:11.164757 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:11.173351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-56a2c141-3511-4dfb-a374-e73a7e7e6241 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1204 microversion: 2.1 time: 0.098735 Aug 07 10:57:11.173934 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 224/446] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:11 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:11.389575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:11.395037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:11.403975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:11.404563 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:11.404926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:11.405636 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:11.406092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:11.406518 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:11.814550 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:11.822848 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d36bd47c-c0cd-42d8-9299-5801b4d9129e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.440553 Aug 07 10:57:11.823509 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 223/447] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:11 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:12.180638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-8fd31cef-5531-4f05-8bdd-03519b1d8e67 req-b0882734-fb60-4d07-8b34-e25fed75d390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223548c0-1e24-46fc-8238-56a431aadfd0", "tag": "2d0a513b-66b5-4ab9-9279-4055a67679fb"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:12.193342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8fd31cef-5531-4f05-8bdd-03519b1d8e67 req-b0882734-fb60-4d07-8b34-e25fed75d390 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:12.193600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8fd31cef-5531-4f05-8bdd-03519b1d8e67 req-b0882734-fb60-4d07-8b34-e25fed75d390 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:12.195294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:12.196960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:12.197880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8fd31cef-5531-4f05-8bdd-03519b1d8e67 req-b0882734-fb60-4d07-8b34-e25fed75d390 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:12.208926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:12.209898 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:12.210447 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:12.211310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:12.211451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-8fd31cef-5531-4f05-8bdd-03519b1d8e67 req-b0882734-fb60-4d07-8b34-e25fed75d390 service nova] Creating event network-changed:2d0a513b-66b5-4ab9-9279-4055a67679fb for instance 223548c0-1e24-46fc-8238-56a431aadfd0 on hv-cinder-85032 Aug 07 10:57:12.212303 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:12.213444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:12.217076 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-8fd31cef-5531-4f05-8bdd-03519b1d8e67 req-b0882734-fb60-4d07-8b34-e25fed75d390 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041375 Aug 07 10:57:12.218111 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 225/448] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:12.446950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:12.455510 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9c21896f-ca20-4bb3-9fb4-28a5831030e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.265179 Aug 07 10:57:12.469823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 224/449] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:12 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:12.846917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:12.847714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:12.854046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:12.854605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:12.855767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:12.856480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:12.856943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:12.857382 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:12.996858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:13.005484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8b05fb90-d33c-450d-b7ce-24ac4f1f038f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.163063 Aug 07 10:57:13.006096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 226/450] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:12 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:13.476775 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:13.477388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:13.484530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:13.485013 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:13.485532 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:13.486259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:13.486737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:13.487209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:13.631017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:13.639409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2980ac16-bbc3-4caf-a4a2-c434df56072f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.166389 Aug 07 10:57:13.640012 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 225/451] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:13 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:14.025790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:14.027214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:14.034950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:14.035531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:14.035971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:14.036716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:14.037210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:14.037640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:14.182692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-690c6b0c-372b-4552-b5ad-e99ae818403b req-f0bddf9c-f6cc-4f2f-89f1-4fe851a4da1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf03e0d-d4df-471c-a17e-db0ab8dbbc1f", "name": "network-vif-plugged", "status": "completed", "tag": "8f5e1d77-61de-4709-a023-e0d9df750ea5"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:14.192676 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:14.194597 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-690c6b0c-372b-4552-b5ad-e99ae818403b req-f0bddf9c-f6cc-4f2f-89f1-4fe851a4da1a service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:14.195331 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-690c6b0c-372b-4552-b5ad-e99ae818403b req-f0bddf9c-f6cc-4f2f-89f1-4fe851a4da1a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:14.195854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-690c6b0c-372b-4552-b5ad-e99ae818403b req-f0bddf9c-f6cc-4f2f-89f1-4fe851a4da1a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:14.202814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4f9f1ddc-e765-4b66-955e-f6484e95eb0d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.180840 Aug 07 10:57:14.211069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-690c6b0c-372b-4552-b5ad-e99ae818403b req-f0bddf9c-f6cc-4f2f-89f1-4fe851a4da1a service nova] Creating event network-vif-plugged:8f5e1d77-61de-4709-a023-e0d9df750ea5 for instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f on hv-cinder-85032 Aug 07 10:57:14.218081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 227/452] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:14 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:14.221471 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-690c6b0c-372b-4552-b5ad-e99ae818403b req-f0bddf9c-f6cc-4f2f-89f1-4fe851a4da1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042907 Aug 07 10:57:14.222073 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 226/453] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:57:14.661253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:14.661861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:14.668552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:14.669038 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:14.669466 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:14.670174 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:14.670672 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:14.671129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:14.811982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:14.819722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cf3ebc2d-3c41-4f32-bb6c-7fcabdd46798 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.162325 Aug 07 10:57:14.820346 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 228/454] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:14 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:15.224360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:15.225037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:15.227205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:15.233766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:15.234038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:15.234409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:15.235130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:15.235580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:15.235995 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:15.377061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:15.384875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a43850c0-f0fe-48bc-b295-9450044b7a98 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.164730 Aug 07 10:57:15.385704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 227/455] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:15 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:15.842892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:15.843611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:15.850397 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:15.850896 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:15.851425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:15.852129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:15.852585 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:15.853007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:16.066101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:16.075816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0a082bc0-18ff-4591-b2be-396ab16f63d0 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.237192 Aug 07 10:57:16.076417 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 229/456] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:15 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:16.406777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:16.407478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:16.414037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:16.414521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:16.414975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:16.415681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:16.416134 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:16.417245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:16.564952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:16.572883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e830ebe6-1a5c-4589-9650-8354eee2ae2b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1372 microversion: 2.1 time: 0.170144 Aug 07 10:57:16.573462 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 228/457] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:16 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:17.098802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:17.099638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:17.101794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:17.102618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:17.109948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:17.110437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:17.110867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:17.111591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:17.112043 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:17.112464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:17.263191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:17.270907 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-94b50eda-03c9-4656-b227-75b2e6aef620 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.176589 Aug 07 10:57:17.271506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 230/458] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:17 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:17.594519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:17.595149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:17.596970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:17.602983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:17.603475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:17.603949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:17.604717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:17.605179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:17.605602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:17.741894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:17.750361 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-580cdca5-aac4-4c7c-8c9a-1f6a3601a4fa tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1566 microversion: 2.1 time: 0.159527 Aug 07 10:57:17.750948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 229/459] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:17 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:17.771647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:17.772142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:17.779081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:17.779575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:17.780018 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:17.780841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:17.781381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:17.781815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:17.860922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3c557432-62b3-479a-8456-9c0021d3df04 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093039 Aug 07 10:57:17.861522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 231/460] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 10:57:17 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:18.294658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:18.295620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:18.302876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:18.303585 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:18.304444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:18.305356 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:18.305903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:18.306397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:18.572938 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:18.580834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-754ed307-48b1-465a-8ec3-3e2255bd02f7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.291320 Aug 07 10:57:18.581400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 230/461] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:18 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:19.165160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-8f1f805a-484c-4123-8467-c0d8a7f1fca6 req-ae41ff19-d5c8-485f-b0f5-9cf999e348ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf03e0d-d4df-471c-a17e-db0ab8dbbc1f", "tag": "8f5e1d77-61de-4709-a023-e0d9df750ea5"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:19.176565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8f1f805a-484c-4123-8467-c0d8a7f1fca6 req-ae41ff19-d5c8-485f-b0f5-9cf999e348ae service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:19.177127 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8f1f805a-484c-4123-8467-c0d8a7f1fca6 req-ae41ff19-d5c8-485f-b0f5-9cf999e348ae service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:19.177685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-8f1f805a-484c-4123-8467-c0d8a7f1fca6 req-ae41ff19-d5c8-485f-b0f5-9cf999e348ae service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:19.189878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-8f1f805a-484c-4123-8467-c0d8a7f1fca6 req-ae41ff19-d5c8-485f-b0f5-9cf999e348ae service nova] Creating event network-changed:8f5e1d77-61de-4709-a023-e0d9df750ea5 for instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f on hv-cinder-85032 Aug 07 10:57:19.199335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-8f1f805a-484c-4123-8467-c0d8a7f1fca6 req-ae41ff19-d5c8-485f-b0f5-9cf999e348ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038648 Aug 07 10:57:19.200223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 232/462] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:19.605538 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:19.606398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:19.613273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:19.613870 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:19.614307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:19.615121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:19.615561 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:19.615989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:19.799468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:19.809292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eb2a87a7-aa5a-4194-a3d6-11ec29dd9216 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.208017 Aug 07 10:57:19.809879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 231/463] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:19 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:20.837085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:20.837822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:20.849274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:20.850085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:20.850908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:20.851628 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:20.852367 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:20.852947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:21.017653 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:21.021196 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:21.027145 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-11e906bf-56b9-4e7e-8b0f-edec4ad2c10e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.195472 Aug 07 10:57:21.027723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 233/464] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:20 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:22.048054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:22.048671 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:22.055774 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:22.056335 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:22.056780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:22.058046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:22.058508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:22.058962 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:22.287634 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:22.295546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fddd2f15-0570-45ea-a824-45d9beb0962f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.251409 Aug 07 10:57:22.296126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 232/465] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:22 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:23.318638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:23.319273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:23.326534 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:23.327106 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:23.327549 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:23.328245 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:23.328705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:23.329129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:23.482521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:23.491217 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-500a62ba-2093-4fa2-8ca7-31c15d0b0d7b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.176133 Aug 07 10:57:23.491784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 234/466] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:23 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:24.516829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:24.517426 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:24.524223 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:24.524723 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:24.525143 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:24.525834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:24.526291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:24.526875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:24.530737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:24.664733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:24.672701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a5e1ae8c-264c-4d42-826b-edfc3d6e0bd4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.159882 Aug 07 10:57:24.673315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 233/467] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:24 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:25.694854 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:25.695511 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:25.703052 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:25.703536 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:25.703970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:25.704664 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:25.705120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:25.705541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:25.834871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:25.842856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-66c0c52f-949b-4a48-a730-46b49848c0b7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.151871 Aug 07 10:57:25.843464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 235/468] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:25 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:26.698737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5f07f5b6-2b70-4a4f-8053-e4b97fdbc5ac req-658d1be3-278f-4b7d-aa98-5c14f0e07ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223548c0-1e24-46fc-8238-56a431aadfd0", "name": "network-vif-plugged", "status": "completed", "tag": "2d0a513b-66b5-4ab9-9279-4055a67679fb"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:26.709664 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5f07f5b6-2b70-4a4f-8053-e4b97fdbc5ac req-658d1be3-278f-4b7d-aa98-5c14f0e07ed8 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:26.711002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5f07f5b6-2b70-4a4f-8053-e4b97fdbc5ac req-658d1be3-278f-4b7d-aa98-5c14f0e07ed8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:26.711556 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5f07f5b6-2b70-4a4f-8053-e4b97fdbc5ac req-658d1be3-278f-4b7d-aa98-5c14f0e07ed8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:26.724884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5f07f5b6-2b70-4a4f-8053-e4b97fdbc5ac req-658d1be3-278f-4b7d-aa98-5c14f0e07ed8 service nova] Creating event network-vif-plugged:2d0a513b-66b5-4ab9-9279-4055a67679fb for instance 223548c0-1e24-46fc-8238-56a431aadfd0 on hv-cinder-85032 Aug 07 10:57:26.731881 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5f07f5b6-2b70-4a4f-8053-e4b97fdbc5ac req-658d1be3-278f-4b7d-aa98-5c14f0e07ed8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036155 Aug 07 10:57:26.732477 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 234/469] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:26.864055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:26.864588 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:26.871652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:26.872142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:26.872550 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:26.873230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:26.873676 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:26.874090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:27.015917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:27.023363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8f52618a-bb04-46d2-9479-c333260f306c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.163151 Aug 07 10:57:27.034951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 236/470] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:26 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:28.044922 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:28.045884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:28.052905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:28.053379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:28.053802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:28.054478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:28.054952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:28.055370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:28.185681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:28.193378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-51c89bea-afe6-480c-aca0-bf776c21c7e4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.152773 Aug 07 10:57:28.193953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 235/471] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:28 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:29.215205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:29.215838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:29.222390 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:29.222890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:29.223335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:29.224024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:29.224480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:29.224904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:29.359974 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:29.367356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-56c3fdec-1732-4f6e-bc2f-dfb7f6474d18 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1260 microversion: 2.1 time: 0.156721 Aug 07 10:57:29.367919 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 237/472] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:29 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:30.388209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:30.388822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:30.395312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:30.395797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:30.396229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:30.396921 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:30.397378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:30.397803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:30.531399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:30.539580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7c984fa0-083a-4b6f-a7d2-56cf2c929833 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1445 microversion: 2.1 time: 0.155259 Aug 07 10:57:30.540231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 236/473] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:30 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:30.560815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:30.561509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:30.567879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:30.568357 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:30.568786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:30.569473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:30.569923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:30.570341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:30.703025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:30.710420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8049803-c66e-4abc-bb38-437cadbbde16 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1445 microversion: 2.1 time: 0.154227 Aug 07 10:57:30.711003 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 238/474] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:30 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:32.643995 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5f0de3ca-0780-453a-b662-1cef7965dd2f req-79b3a3ae-26e7-40bb-86c9-1925dfbcdfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223548c0-1e24-46fc-8238-56a431aadfd0", "tag": "2d0a513b-66b5-4ab9-9279-4055a67679fb"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:32.653760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5f0de3ca-0780-453a-b662-1cef7965dd2f req-79b3a3ae-26e7-40bb-86c9-1925dfbcdfd2 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:32.654240 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5f0de3ca-0780-453a-b662-1cef7965dd2f req-79b3a3ae-26e7-40bb-86c9-1925dfbcdfd2 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:32.654662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5f0de3ca-0780-453a-b662-1cef7965dd2f req-79b3a3ae-26e7-40bb-86c9-1925dfbcdfd2 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:32.665793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5f0de3ca-0780-453a-b662-1cef7965dd2f req-79b3a3ae-26e7-40bb-86c9-1925dfbcdfd2 service nova] Creating event network-changed:2d0a513b-66b5-4ab9-9279-4055a67679fb for instance 223548c0-1e24-46fc-8238-56a431aadfd0 on hv-cinder-85032 Aug 07 10:57:32.672560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5f0de3ca-0780-453a-b662-1cef7965dd2f req-79b3a3ae-26e7-40bb-86c9-1925dfbcdfd2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 Aug 07 10:57:32.673146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 237/475] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:42.255310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2006179060", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "networks": [{"uuid": "efdedc16-3f87-4497-963e-dce0a10e25cb"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:42.263315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=35 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:42.264107 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=30 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:42.310557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] validate_networks() for [('efdedc16-3f87-4497-963e-dce0a10e25cb', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:57:42.653465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:57:42.653887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:57:42.654387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:57:42.654791 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:57:42.655229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:57:42.663949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:42.664424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:42.664850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:42.665563 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:42.666669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:42.667127 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:42.684775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Getting quotas for project 81ab48958e894bdbb5cd46049356a8a0. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:57:42.688616 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Getting quotas for user c4597d928ad24b6c81420f7158e5e98b and project 81ab48958e894bdbb5cd46049356a8a0. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:57:42.700049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:57:42.702293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:57:42.748583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f127995f-e2ba-4b7e-806d-3abd0b271a12 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497332 Aug 07 10:57:42.749229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 239/476] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:57:42.762019 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b2d24800-6e34-4f7b-8cab-8b956f54f93f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:42.762959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b2d24800-6e34-4f7b-8cab-8b956f54f93f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:42.765484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=21 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:42.767105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=21 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:42.826085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b2d24800-6e34-4f7b-8cab-8b956f54f93f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:42.834801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b2d24800-6e34-4f7b-8cab-8b956f54f93f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1219 microversion: 2.1 time: 0.078491 Aug 07 10:57:42.835410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 238/477] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:42 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:43.856177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:43.856731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:43.863119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:43.863610 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:43.864055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:43.864742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:43.865199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:43.865623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:43.933702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:43.941062 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07293350-285a-4881-ad18-70f15d1b8d40 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1271 microversion: 2.1 time: 0.089888 Aug 07 10:57:43.941626 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 240/478] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:43 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:44.949615 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:44.950090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:44.958902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:44.959664 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:44.960106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:44.960895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:44.961390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:44.961975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:44.962117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:44.962880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:44.970506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:44.971142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:44.971682 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:44.972492 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:44.973061 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:44.973663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:44.988459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ca072310-3395-43a7-94d3-5304b0263a51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/ips" status: 200 len: 150 microversion: 2.20 time: 0.042862 Aug 07 10:57:44.989261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 239/479] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Aug 7 10:57:44 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:57:45.178834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:45.191743 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-92b631ce-da2f-42d7-9c40-685d7528b8c7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.233943 Aug 07 10:57:45.192477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 241/480] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:44 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:45.708606 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5474b50f-9461-481b-a74e-8ce8259a3ffc req-ab689ae2-e606-4722-9e6d-8cc01d2d722c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5805b3b-d299-4071-ab05-6bc4d3f96c57", "tag": "67fcb7ee-9dcd-4c2b-a605-f9ec372a3f96"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:45.720245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5474b50f-9461-481b-a74e-8ce8259a3ffc req-ab689ae2-e606-4722-9e6d-8cc01d2d722c service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:45.720818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5474b50f-9461-481b-a74e-8ce8259a3ffc req-ab689ae2-e606-4722-9e6d-8cc01d2d722c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:45.721337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5474b50f-9461-481b-a74e-8ce8259a3ffc req-ab689ae2-e606-4722-9e6d-8cc01d2d722c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:45.733915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5474b50f-9461-481b-a74e-8ce8259a3ffc req-ab689ae2-e606-4722-9e6d-8cc01d2d722c service nova] Creating event network-changed:67fcb7ee-9dcd-4c2b-a605-f9ec372a3f96 for instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 on hv-cinder-85032 Aug 07 10:57:45.739065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5474b50f-9461-481b-a74e-8ce8259a3ffc req-ab689ae2-e606-4722-9e6d-8cc01d2d722c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035516 Aug 07 10:57:45.739549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 240/481] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:46.214113 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:46.214761 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:46.221479 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:46.221963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:46.222402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:46.223154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:46.223612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:46.224034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:46.357450 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:46.365608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-660be043-d58f-4617-9a97-3203b5c674b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.155834 Aug 07 10:57:46.366177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 242/482] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:46 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:47.155126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:47.155744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:47.162295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:47.162775 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:47.163236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:47.163919 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:47.164371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:47.164791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:47.189148 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lazy-loading 'flavor' on Instance uuid 72ec2284-c34f-4e70-b19f-4e762542600e {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:57:47.372111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5b05dfad-e426-44ec-ab99-3b62c5393cb0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/action" status: 202 len: 0 microversion: 2.20 time: 0.220940 Aug 07 10:57:47.372735 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 241/483] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Aug 7 10:57:47 2022] POST /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 10:57:47.380981 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:47.381683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:47.385813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:47.386526 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:47.388659 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:47.389252 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:47.389730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:47.390634 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:47.391141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:47.391585 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:47.393011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:47.393491 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:47.393959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:47.394652 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:47.395146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:47.395599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:47.592534 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:47.595505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:47.600979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:47.602621 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:47.604150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-abd63679-4fde-4e2e-ba5b-0884698362d2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.221718 Aug 07 10:57:47.604574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fdfcda53-aedf-415e-96c5-a480bec51246 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.227420 Aug 07 10:57:47.605234 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 242/485] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:47 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:47.605361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 243/485] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:47 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:57:48.627895 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:48.628567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:48.628938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:48.629043 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:48.635081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:48.635572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:48.636006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:48.636388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:48.636711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:48.636868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:48.637166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:48.637288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:48.637599 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:48.637996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:48.638449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:48.638871 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:48.837015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:48.845882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:48.846112 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:48.847415 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:48.848622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-399fd690-6ef9-47e8-afd2-71f058becc9f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.224730 Aug 07 10:57:48.849188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 244/486] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:48 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:57:48.855258 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0f8dbd05-f50d-49bd-9b86-726aeec203e6 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.231039 Aug 07 10:57:48.856116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 243/487] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:48 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:49.873360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:49.873988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:49.880913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:49.881120 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:49.881523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:49.881857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:49.882039 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:49.882565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:49.883046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:49.883470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:49.890071 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:49.890651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:49.891333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:49.892046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:49.892507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:49.893398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:50.249041 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:50.254683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:50.256950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2e86a9a7-1042-4d0e-9de3-33052e12210f tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.381036 Aug 07 10:57:50.265899 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 244/488] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:49 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:50.266077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:50.266077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:50.266422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-09331d92-3618-4b9b-bf74-f591d6a73111 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.397296 Aug 07 10:57:50.278098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 245/489] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:49 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:57:51.278325 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:51.278957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:51.285454 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:51.285942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:51.286377 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:51.287101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:51.287557 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:51.287980 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:51.288966 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:51.289651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:51.297274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:51.297760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:51.298225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:51.298982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:51.299461 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:51.299870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:51.494285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:51.498758 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:51.502091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-53f19865-8ced-4673-9a29-d672559f9ce1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.228250 Aug 07 10:57:51.514984 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 245/490] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:51 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:51.515204 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:51.515204 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:51.515204 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7a0f4b33-3a1e-41d3-859d-b06910599ee2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.225349 Aug 07 10:57:51.515470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 246/491] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:51 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:57:52.138276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:52.138797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:52.144925 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:52.145403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:52.145832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:52.146511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:52.146988 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:52.147408 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:52.171815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7333be33-b923-438f-879e-402f359f17c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/ips" status: 200 len: 147 microversion: 2.1 time: 0.037634 Aug 07 10:57:52.172383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 246/492] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 10:57:52 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:52.523915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:52.524670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:52.531931 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:52.532414 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:52.532850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:52.533010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:52.533543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:52.533669 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:52.534001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:52.534420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:52.539973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:52.540521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:52.540951 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:52.541651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:52.542114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:52.542506 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:52.675538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:52.695393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:52.727535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:52.735632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-348f6532-bc98-4660-b231-4abc679f2e88 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.215570 Aug 07 10:57:52.736410 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 247/493] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:52 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:52.740395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:52.750591 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:52.752127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:52.753479 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3708b32f-e7f4-4a3c-a4a0-8e6cc5eb969b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.224149 Aug 07 10:57:52.754033 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 247/494] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:52 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:57:53.112853 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-34229617-31c5-483b-9469-32ed1ca27a6b req-54f81eab-276e-43a6-a63f-be1afb84c92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5805b3b-d299-4071-ab05-6bc4d3f96c57", "name": "network-vif-plugged", "status": "completed", "tag": "67fcb7ee-9dcd-4c2b-a605-f9ec372a3f96"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:53.124571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-34229617-31c5-483b-9469-32ed1ca27a6b req-54f81eab-276e-43a6-a63f-be1afb84c92c service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:53.125124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-34229617-31c5-483b-9469-32ed1ca27a6b req-54f81eab-276e-43a6-a63f-be1afb84c92c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:53.125553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-34229617-31c5-483b-9469-32ed1ca27a6b req-54f81eab-276e-43a6-a63f-be1afb84c92c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:53.139574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-34229617-31c5-483b-9469-32ed1ca27a6b req-54f81eab-276e-43a6-a63f-be1afb84c92c service nova] Creating event network-vif-plugged:67fcb7ee-9dcd-4c2b-a605-f9ec372a3f96 for instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 on hv-cinder-85032 Aug 07 10:57:53.145856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-34229617-31c5-483b-9469-32ed1ca27a6b req-54f81eab-276e-43a6-a63f-be1afb84c92c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036235 Aug 07 10:57:53.146459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 248/495] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:53.756495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:53.757151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:53.759855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:53.765749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:53.766237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:53.766675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:53.767407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:53.767865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:53.768295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:53.778383 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:53.779131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:53.785245 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:53.785730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:53.786166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:53.786866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:53.787364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:53.787793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:53.989405 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:53.993230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:53.997650 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6cd022b0-4e73-45f1-97f7-c76b4700ea3e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.244949 Aug 07 10:57:53.998227 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 248/496] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:53 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:54.001480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:54.003049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:54.004216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8e6130c-f8f8-451c-b54f-4e8d96fb2b0c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.231170 Aug 07 10:57:54.004772 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 249/497] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:53 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:57:54.435099 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a20de1d0-1f10-4555-bc9c-04c59a50cfb0"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:57:54.437634 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:54.443974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:54.444450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:54.444909 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:54.445592 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:54.446040 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:54.446484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:55.019308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:55.019946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:55.027700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:55.028177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:55.028604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:55.029338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:55.029820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:55.030296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:55.169984 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-41e05f1c-ac42-4970-af22-aeafe60083d0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739415 Aug 07 10:57:55.176308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 249/498] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:57:54 2022] POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:57:55.185592 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:55.185976 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:55.186688 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:55.193502 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:55.193997 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:55.194434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:55.195219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:55.195682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:55.196119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:55.206528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ddae9b7e-2f08-412b-a66d-1d041699db60 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1319 microversion: 2.1 time: 0.190357 Aug 07 10:57:55.223046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 250/499] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:55 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:57:55.341463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:55.349486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:55.351011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:55.352179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eca70e5f-8659-4e14-9883-088a89f8fdc7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.174824 Aug 07 10:57:55.353235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 250/500] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:55 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:57:56.231116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:56.231722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:56.238271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:56.238741 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:56.239197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:56.239969 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:56.240413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:56.240823 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:56.375535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:56.376236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:56.378537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:56.382591 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:56.383142 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:56.383585 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:56.384398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:56.385008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:56.385144 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:56.386226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dae3545c-144b-435c-ad27-8c80a2cc4c04 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1508 microversion: 2.1 time: 0.159740 Aug 07 10:57:56.387005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 251/501] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:57:56 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:57:56.522630 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:56.532514 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:56.534007 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:56.535193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c91ee939-2d6a-446c-beaa-c7f84af76312 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.163553 Aug 07 10:57:56.535749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 251/502] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:56 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:57:57.558472 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:57.559103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:57.565642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:57.566067 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:57.566498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:57.567214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:57.567668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:57.568090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:57.702604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:57.710388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:57.711899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:57.713945 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ea2cb3d2-7441-4728-a922-dbf352297a99 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.159553 Aug 07 10:57:57.714496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 252/503] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:57 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:57:58.738025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:58.738552 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:58.745595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:58.746081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:58.746514 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:58.747247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:58.747706 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:58.748139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:58.882018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:58.890524 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:58.892032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:57:58.893186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d2815f9a-0a44-463e-902a-0616f074e6d3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.159117 Aug 07 10:57:58.893745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 252/504] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:58 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:57:59.916872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:57:59.917481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:57:59.924367 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:59.924843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:59.925273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:57:59.925954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:57:59.926435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:57:59.926855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:00.058725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:00.066778 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:00.068306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:00.069460 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7feb2520-772d-41ff-abdc-b999f43de1be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.156459 Aug 07 10:58:00.070012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 253/505] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:57:59 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:01.093443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:01.094058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:01.100415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:01.100896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:01.101330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:01.102017 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:01.102512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:01.102949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:01.121647 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:01.248964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:01.256769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:01.258271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:01.259425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9afbfb89-06a6-4a40-8560-b0e11b052733 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.171206 Aug 07 10:58:01.259973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 253/506] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:01 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:02.282757 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:02.283400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:02.289843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:02.290303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:02.290742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:02.291477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:02.291927 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:02.292347 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:02.424166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:02.431945 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:02.433473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:02.434708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-892a23c9-4bad-4bf6-836b-833607c9dba1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.155863 Aug 07 10:58:02.435286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 254/507] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:02 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:03.457567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:03.458821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:03.465723 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:03.466211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:03.466646 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:03.467386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:03.467844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:03.468268 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:03.599600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:03.608351 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:03.609845 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:03.611050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1aa31f14-c811-47bd-b420-8dd4d328b59a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.157360 Aug 07 10:58:03.611608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 254/508] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:03 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:03.784673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-17257d3f-ab70-478e-9158-adc064f8999a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:03.791331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17257d3f-ab70-478e-9158-adc064f8999a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:03.791816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17257d3f-ab70-478e-9158-adc064f8999a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:03.792247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17257d3f-ab70-478e-9158-adc064f8999a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:03.853548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-17257d3f-ab70-478e-9158-adc064f8999a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Going to try to stop instance {{(pid=117615) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 10:58:03.892428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:03.901537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-17257d3f-ab70-478e-9158-adc064f8999a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action" status: 202 len: 0 microversion: 2.1 time: 0.120512 Aug 07 10:58:03.905673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 255/509] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:58:03 2022] POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:58:03.911137 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:03.911781 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:03.924371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:03.924901 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:03.925369 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:03.926177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:03.926770 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:03.927315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:04.063102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:04.071045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-421a9dee-5668-4279-8c19-6ad1fb4c4a55 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.163729 Aug 07 10:58:04.071729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 255/510] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:03 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:04.635670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:04.636396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:04.644282 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:04.644796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:04.645298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:04.646105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:04.646650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:04.647138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:04.782900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:04.791521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:04.793442 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:04.794973 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1a2aa45-3b9a-43b5-a947-4cf400a75270 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.164737 Aug 07 10:58:04.795566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 256/511] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:04 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:05.092735 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:05.093439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:05.100428 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:05.100910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:05.101341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:05.102039 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:05.102496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:05.102958 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:05.244571 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:05.253071 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33aa48ba-005a-4062-bea3-729d2e47bbcd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.165001 Aug 07 10:58:05.253636 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 256/512] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:05 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:05.818813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:05.819505 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:05.826599 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:05.827091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:05.827519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:05.828198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:05.828646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:05.829060 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:05.961737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:05.970517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:05.972181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:05.973336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2c3c80b0-34f3-4d6f-a7c0-860100fc370d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.158969 Aug 07 10:58:05.973897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 257/513] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:05 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:06.275262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:06.276143 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:06.283159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:06.283639 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:06.284068 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:06.284758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:06.285205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:06.285620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:06.415989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:06.425050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e3ea8ec7-1526-46ce-acf5-038ef5324bb2 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.155165 Aug 07 10:58:06.425635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 257/514] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:06 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:06.995992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:06.996584 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:07.003564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:07.004049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:07.004481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:07.005173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:07.005622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:07.006035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:07.150832 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:07.159641 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:07.161148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:07.162314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fdf30309-cea7-4ee5-998b-87ff2f83c918 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.170401 Aug 07 10:58:07.162907 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 258/515] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:06 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:07.446813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:07.447484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:07.454443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:07.454975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:07.455400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:07.456131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:07.456590 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:07.457015 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:07.595987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:07.604112 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3040f536-495f-45a4-94fb-80175e59ddf4 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.162024 Aug 07 10:58:07.604675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 258/516] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:07 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:08.186156 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:08.186754 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:08.193460 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:08.193943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:08.194382 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:08.195112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:08.195569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:08.195992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:08.332767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:08.341993 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:08.343541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:08.344708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8be3e8b3-50c1-4642-ab56-dca6f22dee3e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.163071 Aug 07 10:58:08.345264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 259/517] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:08 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:08.625863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:08.626413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:08.632839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:08.633324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:08.633761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:08.634451 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:08.634910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:08.635364 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:08.770537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:08.779124 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9721e319-cbec-4685-b53a-bf70217e6aed tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.157340 Aug 07 10:58:08.779691 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 259/518] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:08 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:09.203212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-13ac8e05-9e92-4617-ba72-ba9640883994 req-1480c5d1-62f6-4e56-9563-bddc136d0659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ec2284-c34f-4e70-b19f-4e762542600e", "name": "network-vif-plugged", "status": "completed", "tag": "90ed1281-54b7-4284-9826-dc980d8a465a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:09.217717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-13ac8e05-9e92-4617-ba72-ba9640883994 req-1480c5d1-62f6-4e56-9563-bddc136d0659 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:09.218354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-13ac8e05-9e92-4617-ba72-ba9640883994 req-1480c5d1-62f6-4e56-9563-bddc136d0659 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:09.218842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-13ac8e05-9e92-4617-ba72-ba9640883994 req-1480c5d1-62f6-4e56-9563-bddc136d0659 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:09.230200 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-13ac8e05-9e92-4617-ba72-ba9640883994 req-1480c5d1-62f6-4e56-9563-bddc136d0659 service nova] Creating event network-vif-plugged:90ed1281-54b7-4284-9826-dc980d8a465a for instance 72ec2284-c34f-4e70-b19f-4e762542600e on hv-cinder-85032 Aug 07 10:58:09.235988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-13ac8e05-9e92-4617-ba72-ba9640883994 req-1480c5d1-62f6-4e56-9563-bddc136d0659 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039018 Aug 07 10:58:09.236846 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 260/519] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:58:09.367899 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:09.368436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:09.375255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:09.375734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:09.376162 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:09.376851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:09.377302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:09.377724 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:09.511258 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:09.519188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:09.520668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:09.521811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6ec2b25d-1fa8-4183-96a6-34aeac8b6847 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.157841 Aug 07 10:58:09.522365 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 260/520] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:09 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:09.800587 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:09.801559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:09.807637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:09.808120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:09.808670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:09.809361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:09.809825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:09.810248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:09.940972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:09.949093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-affb877c-b8dd-4f2c-b336-104bbd4a8253 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.152663 Aug 07 10:58:09.949658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 261/521] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:09 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:10.544757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:10.545414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:10.552508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:10.553075 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:10.553563 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:10.554287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:10.554792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:10.555222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:10.687749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:10.695583 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:10.697081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:10.698244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-86060924-52a5-41c2-9cd8-2e4254190368 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.158066 Aug 07 10:58:10.698814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 261/522] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:10 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:10.970172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:10.970715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:10.977139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:10.977621 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:10.978059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:10.978747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:10.979233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:10.979662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:11.113305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:11.121297 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-83216213-c9fe-4500-bd6b-1ec22594479f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.155096 Aug 07 10:58:11.121854 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 262/523] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:10 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:11.721052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:11.721821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:11.728184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:11.728655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:11.729081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:11.729785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:11.730306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:11.730716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:11.861139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:11.869076 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:11.871139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:11.872483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6a0dac2f-ad46-4d9c-adf4-cfd996e1caee tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.155359 Aug 07 10:58:11.873045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 262/524] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:11 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:12.142135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:12.142777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:12.149097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:12.149576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:12.150031 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:12.150713 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:12.151195 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:12.151617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:12.289378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:12.297439 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5b92a7e-6f7f-4bc6-9af6-b18eba65d322 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.159073 Aug 07 10:58:12.298004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 263/525] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:12 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:12.898260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:12.899271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:12.902421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=53 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:12.907723 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:12.908200 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:12.908622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:12.909306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:12.909754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:12.910171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:13.038329 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:13.046796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:13.048314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:13.049495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f94eeba2-6c87-401c-a9e2-aa39f26f93ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.157822 Aug 07 10:58:13.050046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 263/526] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:12 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:13.318906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:13.319525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:13.321933 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:13.327637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:13.328116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:13.328702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:13.329624 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:13.330196 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:13.330849 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:13.462549 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:13.471242 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1b779e53-4a69-4cff-b359-f85aac0c70dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.156110 Aug 07 10:58:13.471797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 264/527] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:13 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:14.072579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:14.073175 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:14.079839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:14.080315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:14.080748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:14.081428 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:14.081883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:14.082304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:14.215185 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:14.222983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:14.224509 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:14.225666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1cbb7324-573a-4da4-8428-e5edc22c45be tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.157029 Aug 07 10:58:14.226222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 264/528] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:14 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:14.492520 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:14.493138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:14.500331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:14.500816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:14.501252 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:14.501941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:14.502397 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:14.502820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:14.632056 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:14.640656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-74cf7f1b-9821-4ad4-92d8-85fc60e27766 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.152012 Aug 07 10:58:14.641224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 265/529] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:14 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:15.250444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:15.251077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:15.257442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:15.257921 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:15.258353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:15.259064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:15.259520 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:15.259938 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:15.393131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:15.400987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:15.402866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:15.404047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-28aa937d-3c70-423e-9228-02a67c468fa3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1744 microversion: 2.20 time: 0.158536 Aug 07 10:58:15.404603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 265/530] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:15 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:15.660532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:15.661438 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:15.668423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:15.668956 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:15.669393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:15.670085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:15.670538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:15.670987 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:15.804474 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:15.812477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7778f7f3-0fd2-4beb-b80f-d523aa6a273c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.155783 Aug 07 10:58:15.813253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 266/531] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:15 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:16.427467 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:16.428085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:16.435143 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:16.435618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:16.436045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:16.436728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:16.437213 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:16.437822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:16.577852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:16.586121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:16.587744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:16.589034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-71788e49-c178-4e43-955a-e06728401219 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.165562 Aug 07 10:58:16.589761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 266/532] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:16 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:16.836704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:16.840024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:16.852798 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:16.853285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:16.853793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:16.862497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:16.863486 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:16.864232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:17.006488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:17.020090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0144c872-f005-440d-ba53-e16cfa3fc268 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.190014 Aug 07 10:58:17.035292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 267/533] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:16 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:17.612629 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:17.613248 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:17.619772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:17.620252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:17.621187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:17.621878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:17.622319 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:17.622736 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:17.760228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:17.768227 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:17.769724 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:17.770890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d460ba4a-4346-4687-8d00-83840e70929a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.162167 Aug 07 10:58:17.771743 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 267/534] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:17 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:18.041522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:18.042143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:18.049579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:18.050058 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:18.050488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:18.051193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:18.051647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:18.052064 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:18.193696 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:18.202305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4115b570-e94b-4ff9-89db-aef1b490bab0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.164640 Aug 07 10:58:18.203271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 268/535] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:18 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:18.795389 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:18.796799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:18.803876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:18.804406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:18.804824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:18.805520 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:18.805975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:18.806399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:18.951209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:18.956392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:18.957910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:18.959105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-09075b58-1e92-464e-9026-5bbf89fa2eef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.169625 Aug 07 10:58:18.959648 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 268/536] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:18 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:19.223193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:19.224182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:19.235313 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:19.235899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:19.236432 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:19.237207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:19.237726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:19.238231 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:19.395395 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:19.405782 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f6387b0f-7f20-4512-9faf-eed89ac9db8c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1724 microversion: 2.1 time: 0.186450 Aug 07 10:58:19.406510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 269/537] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:19 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:19.982135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:19.983020 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:19.989951 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:19.990437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:19.990867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:19.991585 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:19.992048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:19.992467 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:20.156465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:20.164431 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:20.165931 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:20.167116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c70ecefd-83c5-4a5e-9e88-9b9d89ddb410 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.189303 Aug 07 10:58:20.168415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 269/538] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:19 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:20.428697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:20.429299 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:20.437919 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:20.438407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:20.438837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:20.439580 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:20.440038 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:20.440460 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:20.621350 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:20.629963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1143dc45-e92d-4f17-a4f2-698c7500f9e3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1701 microversion: 2.1 time: 0.205049 Aug 07 10:58:20.630539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 270/539] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:20 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1701 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:20.651310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2fd4b98f-be73-4b9e-b79f-3f96b1cd0588 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:20.658024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd4b98f-be73-4b9e-b79f-3f96b1cd0588 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:20.658766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd4b98f-be73-4b9e-b79f-3f96b1cd0588 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:20.659436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd4b98f-be73-4b9e-b79f-3f96b1cd0588 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:20.688022 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:20.723188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2fd4b98f-be73-4b9e-b79f-3f96b1cd0588 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Going to try to start instance {{(pid=117616) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 10:58:20.773383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2fd4b98f-be73-4b9e-b79f-3f96b1cd0588 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action" status: 202 len: 0 microversion: 2.1 time: 0.125250 Aug 07 10:58:20.777612 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 270/540] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:58:20 2022] POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:58:20.783178 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:20.784052 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:20.796708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:20.797692 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:20.798421 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:20.799454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:20.800003 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:20.800544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:20.971645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:20.981872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07536bcf-3076-4210-abac-04211a08874a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1710 microversion: 2.1 time: 0.202652 Aug 07 10:58:20.983023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 271/541] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:20 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1710 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:21.192414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:21.193103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:21.201042 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:21.201535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:21.201976 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:21.202674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:21.203156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:21.203578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:21.340244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:21.348761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:21.350278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:21.351484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1482921c-fd6f-4224-8bd2-18d0df9768f6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.163737 Aug 07 10:58:21.352052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 271/542] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:21 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:22.016871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:22.018499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:22.029539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:22.029539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:22.029948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:22.036866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:22.036866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:22.036866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:22.299101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:22.312960 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3ea41194-1b02-45ca-8e3f-abae523dc590 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1710 microversion: 2.1 time: 0.303483 Aug 07 10:58:22.314343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 272/543] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:22 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1710 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:22.375151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:22.376481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:22.383404 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:22.383974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:22.384472 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:22.385291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:22.385835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:22.386333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:22.528757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:22.539092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:22.540537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:22.541841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f0aed0b4-de08-44ef-b513-2ffc8ba3082e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.171087 Aug 07 10:58:22.543058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 272/544] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:22 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:23.234519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccaae87d-a1c4-4ffb-9b38-761ea11bdf03", "device": "/dev/sdb"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:23.238355 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:23.245267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:23.246841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:23.247294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:23.248247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:23.248881 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:23.249507 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:23.290831 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:23.345799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:23.350092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:23.363461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:23.364117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:23.364655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:23.365546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:23.366110 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:23.366649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:23.573177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:23.585576 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dec8c08e-a02a-4d33-94eb-b3eaccd67928 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1710 microversion: 2.1 time: 0.250453 Aug 07 10:58:23.586386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 273/545] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:23 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1710 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:23.593138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:23.594524 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:23.602006 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:23.602494 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:23.602949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:23.603959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:23.604421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:23.605434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:23.760740 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:23.772533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:23.774026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:23.775361 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fb39e60c-1364-40f3-8430-e892c074ab26 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.188107 Aug 07 10:58:23.776261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 274/546] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:23 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:24.220069 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-06780a3a-36a1-4207-8bb2-37b972545b71 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "POST /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.990476 Aug 07 10:58:24.220978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 273/547] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:58:23 2022] POST /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57/os-volume_attachments => generated 194 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:58:24.616955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:24.617491 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:24.625276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:24.625771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:24.626212 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:24.627413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:24.627885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:24.628369 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:24.804463 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:24.805541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:24.813396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:24.813885 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:24.814349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:24.815269 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:24.815735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:24.816143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:25.064609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:25.073693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-37b9f2a5-5610-406c-8f61-5e7936f2cc50 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1714 microversion: 2.1 time: 0.460535 Aug 07 10:58:25.090119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 275/548] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:24 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1714 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:25.134543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:25.143455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:25.144938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:25.146142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-153c6717-2c48-4d52-92d0-a855cf44eba7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.347779 Aug 07 10:58:25.146723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 274/549] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:24 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:26.169326 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:26.170829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:26.178858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:26.179659 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:26.180433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:26.181226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:26.181754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:26.182242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:26.328314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:26.337616 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:26.340342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:26.341514 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-10929976-c39d-4aff-9101-ae4f2ed1755d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.176729 Aug 07 10:58:26.342070 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 276/550] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:26 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:27.367124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:27.368386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:27.376009 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:27.377253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:27.377700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:27.378408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:27.378870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:27.379323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:27.554737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:27.569192 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:27.571208 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:27.572229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-99f067cb-e782-4174-85c9-b9c6a0b6264f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.210105 Aug 07 10:58:27.587413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 275/551] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:27 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:28.595783 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:28.596635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:28.605394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:28.606404 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:28.606839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:28.607590 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:28.608303 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:28.608798 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:28.772402 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:28.781766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:28.783455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:28.784667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9dab2da6-ce02-4355-9ef2-d39ece47f3fd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.192773 Aug 07 10:58:28.785221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 277/552] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:28 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:29.807978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:29.808888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:29.815708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:29.816266 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:29.816767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:29.817485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:29.817941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:29.818390 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:29.957142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:29.966855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:29.968422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:29.969612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7a1e870-02a5-427b-a8c0-dd22df3ee949 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.165726 Aug 07 10:58:29.971541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 276/553] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:29 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:30.263663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:30.265957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:30.272601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:30.273088 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:30.273521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:30.274212 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:30.274666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:30.275136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:30.346484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-86945ad5-05f3-45c5-ac5e-443102b49be1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.087086 Aug 07 10:58:30.347149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 278/554] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:58:30 2022] POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:58:30.355202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:30.355935 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:30.362212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:30.362757 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:30.363229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:30.363906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:30.364352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:30.364768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:30.506323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:30.514456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-070bad00-6f47-43af-b706-294931b8ff26 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1750 microversion: 2.1 time: 0.163051 Aug 07 10:58:30.515010 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 277/555] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:30 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:30.994025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:30.994728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:31.001207 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:31.001684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:31.002119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:31.002801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:31.003292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:31.003715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:31.139349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:31.147180 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:31.148674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:31.149824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-995e92eb-daf7-4a89-87a8-83e2051bb7ca tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1739 microversion: 2.20 time: 0.160199 Aug 07 10:58:31.150392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 279/556] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:30 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:31.535937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:31.536547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:31.542851 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:31.543359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:31.543794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:31.544470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:31.544921 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:31.545364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:31.687948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:31.700744 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ed2c70ed-b03f-4c5e-a1b8-3b0bbd4f1604 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1750 microversion: 2.1 time: 0.166386 Aug 07 10:58:31.700744 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 278/557] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:31 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:32.172889 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:32.173499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:32.180463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:32.180949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:32.181381 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:32.182068 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:32.182522 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:32.183592 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:32.314672 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:32.322517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:32.324182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:32.325339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9728a583-4325-46cd-a148-2610c87351c8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1721 microversion: 2.20 time: 0.156355 Aug 07 10:58:32.325900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 280/558] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:32 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:32.721377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:32.722197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:32.728862 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:32.729352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:32.729822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:32.730531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:32.731020 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:32.731449 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:32.945306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:32.955722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30c8fa46-4696-43d9-ae8e-4c289bd90f9a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1750 microversion: 2.1 time: 0.237920 Aug 07 10:58:32.956326 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 279/559] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:32 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:33.288353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-1f587839-a1bd-43f0-9bf5-a427ba572868 req-3b5b1416-9697-4ed2-8862-ab96bf03fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ec2284-c34f-4e70-b19f-4e762542600e", "name": "network-vif-unplugged", "status": "completed", "tag": "90ed1281-54b7-4284-9826-dc980d8a465a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:33.301628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1f587839-a1bd-43f0-9bf5-a427ba572868 req-3b5b1416-9697-4ed2-8862-ab96bf03fe1e service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:33.302333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1f587839-a1bd-43f0-9bf5-a427ba572868 req-3b5b1416-9697-4ed2-8862-ab96bf03fe1e service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:33.303037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1f587839-a1bd-43f0-9bf5-a427ba572868 req-3b5b1416-9697-4ed2-8862-ab96bf03fe1e service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:33.316044 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-1f587839-a1bd-43f0-9bf5-a427ba572868 req-3b5b1416-9697-4ed2-8862-ab96bf03fe1e service nova] Creating event network-vif-unplugged:90ed1281-54b7-4284-9826-dc980d8a465a for instance 72ec2284-c34f-4e70-b19f-4e762542600e on hv-cinder-85032 Aug 07 10:58:33.321751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-1f587839-a1bd-43f0-9bf5-a427ba572868 req-3b5b1416-9697-4ed2-8862-ab96bf03fe1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036954 Aug 07 10:58:33.323229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 281/560] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:58:33.349103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:33.350228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:33.357612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:33.358581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:33.359209 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:33.359907 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:33.360362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:33.360838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:33.496769 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:33.504742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:33.506362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:33.507545 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cd02e643-a570-4ee8-b1cf-63d0c19dfca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1721 microversion: 2.20 time: 0.162604 Aug 07 10:58:33.508105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 280/561] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:33 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:33.978156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:33.978886 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:33.986391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:33.986867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:33.987321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:33.988003 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:33.988455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:33.988873 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:34.129632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:34.138459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bec49f8d-3b45-4ef4-af9b-be0e8534d12f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.164434 Aug 07 10:58:34.139035 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 282/562] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:33 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:34.530297 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:34.530947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:34.537291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:34.537768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:34.538198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:34.538878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:34.539352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:34.539770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:34.674736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:34.683273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:34.684790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:34.685931 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-54492f84-0194-4a9d-8195-ce3eb0455de3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1721 microversion: 2.20 time: 0.159754 Aug 07 10:58:34.686480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 281/563] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:34 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:35.160364 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:35.160975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:35.170500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:35.171025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:35.171455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:35.172152 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:35.172602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:35.173046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:35.316786 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:35.325290 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-148c7497-b8fa-4024-9e45-fcbac8b77e19 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.168755 Aug 07 10:58:35.325855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 283/564] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:35 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:35.710499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:35.710499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:35.717363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:35.717836 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:35.718271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:35.718973 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:35.719422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:35.719839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:35.849253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:35.857266 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:35.859073 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:35.860220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7134cf72-1712-42aa-827d-6321536590e5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1721 microversion: 2.20 time: 0.155257 Aug 07 10:58:35.860771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 282/565] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:35 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:36.347439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:36.348043 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:36.354529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:36.355122 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:36.355556 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:36.356230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:36.356677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:36.357093 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:36.498560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:36.506436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-73ceff7d-0c0e-4b5a-bb9e-262622280d1f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.162777 Aug 07 10:58:36.507025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 284/566] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:36 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:36.881518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:36.882123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:36.888666 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:36.889141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:36.889567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:36.890243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:36.890687 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:36.891148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:37.018644 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:37.027315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:37.028811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:37.029955 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9dae7728-3cfe-49d6-9b03-faa0d3c3d5d7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1721 microversion: 2.20 time: 0.152307 Aug 07 10:58:37.030499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 283/567] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:36 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:37.527539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:37.528141 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:37.534421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:37.534913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:37.535425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:37.536104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:37.536550 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:37.536970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:37.554383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:37.682020 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:37.690448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b4255f9e-4442-4b9a-85fa-708568bccd0d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.166870 Aug 07 10:58:37.691035 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 285/568] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:37 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:38.052608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:38.053212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:38.059754 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:38.060228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:38.060658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:38.061334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:38.061786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:38.062200 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:38.191672 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:38.200135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:38.201649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:38.202814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-735df708-ab6a-4739-98a7-de28fde91884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1721 microversion: 2.20 time: 0.154078 Aug 07 10:58:38.203420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 284/569] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:38 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:38.711578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:38.712138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:38.718720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:38.719231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:38.719673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:38.720357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:38.720813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:38.721243 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:38.868878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:38.877398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-25071f07-e35a-4a4e-9234-13b223849741 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.169850 Aug 07 10:58:38.877963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 286/570] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:38 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:39.225526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:39.226152 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:39.233558 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.234042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.234473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.235242 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.235692 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.236109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.370188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:39.378575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:39.380212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:39.381386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c11ada4c-5a03-422c-8871-7a1aaa5255fb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1664 microversion: 2.20 time: 0.159765 Aug 07 10:58:39.381945 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 285/571] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:39 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:39.404977 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "778275a5-01ce-4701-8c34-509784c15ea2"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:39.407368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:39.413694 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.414107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.414418 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.415187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.415697 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.416157 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.695626 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-413ac771-033c-4262-a2ce-d0fbd6b1d321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295276 Aug 07 10:58:39.696238 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 287/572] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Aug 7 10:58:39 2022] POST /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 10:58:39.816255 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:58:39.816854 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:39.822729 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.823473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.823961 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.824649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.825109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.825532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.868107 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117615) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 10:58:39.898641 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:39.899290 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:39.906286 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.906771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.907248 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.907948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.908405 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.908834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.936113 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dd2806a2-352e-4348-9283-5ba3ae241673 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/action" status: 202 len: 0 microversion: 2.20 time: 0.123923 Aug 07 10:58:39.936897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 286/573] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Aug 7 10:58:39 2022] POST /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 10:58:39.944612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:39.945174 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:39.951931 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.952432 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.952874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.953593 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:39.954054 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:39.954483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:39.973759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:40.122247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:40.131508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9862e3a0-84f6-42a8-a90f-45bc995d1f65 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.236610 Aug 07 10:58:40.132349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 288/574] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:39 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:40.149589 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:40.158872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:40.160435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:40.161627 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-93b3f5cb-bb48-4215-80af-80ce639e1190 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1750 microversion: 2.20 time: 0.220791 Aug 07 10:58:40.162219 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 287/575] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:39 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:41.154215 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:41.154809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:41.161171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:41.161647 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:41.162071 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:41.162745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:41.163222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:41.163694 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:41.185824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:41.186443 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:41.192837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:41.193318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:41.193753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:41.194444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:41.195100 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:41.195548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:41.376942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:41.382478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:41.385493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:41.388317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:41.389633 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f2ae7978-f5f7-4ecb-9cc8-199e203e0c05 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1750 microversion: 2.20 time: 0.208143 Aug 07 10:58:41.390208 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 288/576] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:41 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:41.391062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3ef7c9c1-2512-4d00-a177-197ee2b15911 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.241326 Aug 07 10:58:41.391624 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 289/577] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:41 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:42.412248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:42.412799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:42.413152 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:42.413270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:42.419266 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:42.419442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:42.419755 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:42.419869 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:42.420188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:42.420291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:42.420892 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:42.420992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:42.421340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:42.421456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:42.421756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:42.421856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:42.627173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:42.632218 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:42.636422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:42.637939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:42.639132 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-889b8615-028c-4df4-9508-14f82afcb884 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1750 microversion: 2.20 time: 0.230763 Aug 07 10:58:42.639698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 290/578] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:42 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:42.640694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e681ed3-de99-4ec0-8378-0491dcb3dc13 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.232249 Aug 07 10:58:42.641363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 289/579] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:42 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:43.662016 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:43.662624 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:43.663026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:43.663121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:43.664991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:43.666274 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=56 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:43.670499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:43.670668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:43.671002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:43.671236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:43.671444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:43.671670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:43.672142 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:43.672349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:43.672603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:43.672798 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:43.673028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:43.673214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:43.868931 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:43.877926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:43.879448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:43.880609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-acbb5873-e5cd-40d7-97d0-1d4814b673cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1750 microversion: 2.20 time: 0.222403 Aug 07 10:58:43.881174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 291/580] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:43 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1750 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:43.885317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:43.894835 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-47957184-d023-4fdb-9c5d-4ee2425ef5c0 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.236591 Aug 07 10:58:43.895413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 290/581] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:43 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:44.904574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:44.905190 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:44.912480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:44.912963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:44.913391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:44.914084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:44.914533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:44.914966 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:44.915423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:44.916097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:44.922647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:44.923171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:44.923612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:44.924307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:44.924766 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:44.925189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:45.105087 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:45.113627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:45.115140 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:45.116296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ba865d45-a179-4553-8325-8e2ab54f22f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1752 microversion: 2.20 time: 0.216328 Aug 07 10:58:45.116853 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 292/582] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:44 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:45.125764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:45.133772 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-40c9d303-75da-4c0c-aaa1-0225b13e2bcd tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.222240 Aug 07 10:58:45.134272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 291/583] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:44 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:46.139445 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:46.140082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:46.146057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:46.146562 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:46.147027 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:46.147714 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:46.148165 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:46.148584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:46.157870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:46.158487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:46.166056 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:46.166809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:46.167279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:46.168238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:46.168708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:46.169130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:46.363021 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:46.371557 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:46.373048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:46.374209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2bb3111b-0f73-4380-9101-5589e8f84baa tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1752 microversion: 2.20 time: 0.239660 Aug 07 10:58:46.374810 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 293/584] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:46 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1752 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:46.383948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:46.392523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7a49ec01-ecc0-4dde-93bd-8398884967c6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.239480 Aug 07 10:58:46.393094 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 292/585] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:46 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:47.397189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:47.397849 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:47.404868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:47.405341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:47.405764 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:47.406449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:47.406894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:47.407345 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:47.413920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:47.415092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:47.423035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:47.423600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:47.424045 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:47.424767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:47.425225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:47.425645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:47.612110 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:47.620483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:47.622238 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:47.623442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-96871ee8-b509-4f69-ba21-3ebc393d97dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.230140 Aug 07 10:58:47.624011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 294/586] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:47 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:47.628768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:47.637176 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0fe3b821-e0c1-4a0b-96ac-60d2e5b4d563 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.227330 Aug 07 10:58:47.637893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 293/587] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:47 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:48.647094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:48.647748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:48.653754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:48.654243 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:48.654677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:48.655407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:48.655866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:48.656295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:48.658022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:48.658629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:48.664395 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:48.664879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:48.665308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:48.665987 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:48.666437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:48.666856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:48.851896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:48.861715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:48.863113 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:48.864500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-44da5d5f-9249-4e70-8a32-aabcf8827865 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.222351 Aug 07 10:58:48.866255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 295/588] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:48 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:48.870253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:48.878571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6bb2309b-4b6e-4508-82ee-650f4243b0e9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.224828 Aug 07 10:58:48.879176 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 294/589] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:48 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:49.888227 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:49.888871 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:49.895400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:49.895879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:49.896326 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:49.897001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:49.897446 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:49.897893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:49.901910 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:49.903138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:49.909858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:49.910353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:49.910788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:49.911538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:49.911994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:49.912446 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:50.088792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:50.097314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:50.098901 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:50.100106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-51492993-a1e4-4027-823a-e7c446f1e6f9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.215822 Aug 07 10:58:50.100652 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 296/590] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:49 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:50.114552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:50.123148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-98aca5f0-ac9d-465d-a307-7162cc244403 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.225602 Aug 07 10:58:50.123706 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 295/591] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:49 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:51.124638 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:51.125332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:51.131661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:51.132150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:51.132586 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:51.133281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:51.133737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:51.134162 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:51.143333 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:51.143923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:51.150763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:51.151275 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:51.151764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:51.152450 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:51.153078 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:51.153708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:51.342562 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:51.352334 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:51.354125 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:51.357235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48c1a96b-0ec2-475b-89b9-246fb10548b4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.235268 Aug 07 10:58:51.358066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 297/592] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:51 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:51.358964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:51.366984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f88bec52-ff03-4aa5-84f8-2a5c0ff4d349 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.227464 Aug 07 10:58:51.367547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 296/593] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:51 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:52.381584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:52.382284 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:52.388250 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:52.388874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:52.389120 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:52.389642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:52.390052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:52.390756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:52.391256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:52.391674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:52.396908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:52.396908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:52.396908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:52.397290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:52.397515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:52.398123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:52.608655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:52.616962 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:52.618446 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:52.619779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d6443f43-e1bd-4c19-b6b6-28f982a06c56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.241932 Aug 07 10:58:52.620186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 298/594] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:52 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:52.622229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:52.630391 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-524a5215-7c6f-410e-ad3c-3054ef18fce4 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.246098 Aug 07 10:58:52.631010 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 297/595] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:52 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:53.641810 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:53.642460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:53.648813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:53.649282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:53.649709 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:53.650383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:53.650701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:53.651135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:53.651271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:53.651419 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:53.657856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:53.658336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:53.658770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:53.659488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:53.659946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:53.660368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:53.672199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:53.878697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:53.881790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:53.888066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f70b98f5-7f6c-4729-9429-5ca76a5f3bff tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.241060 Aug 07 10:58:53.888632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 298/596] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:53 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:53.905077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:53.906683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:53.907990 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-89dd0c3d-1143-4272-853e-0a619a63740f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.270017 Aug 07 10:58:53.908623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 299/597] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:53 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:54.909848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:54.910437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:54.917033 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:54.917543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:54.918782 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:54.919645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:54.920116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:54.920559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:54.931378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:54.933124 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:54.940670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:54.941595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:54.942113 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:54.950838 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:54.951711 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:54.952403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:55.154660 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:55.155107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:55.167690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7fcbf7ba-8559-4ade-bbf6-6b7045f64ed1 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.261833 Aug 07 10:58:55.179244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:55.179790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 299/598] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:54 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:55.181370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:55.184002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d526d4ae-27aa-4d04-b7f0-3061c65a2c51 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.256355 Aug 07 10:58:55.185193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 300/599] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:54 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:55.285890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:55.286387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:55.292234 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:55.293247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:55.293704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:55.294386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:55.294844 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:55.295287 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:55.429960 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lazy-loading 'services' on Instance uuid a5805b3b-d299-4071-ab05-6bc4d3f96c57 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:58:55.549651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8fe7721a-5005-4955-8ef5-ba4bd0f59b1d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57/os-volume_attachments/ccaae87d-a1c4-4ffb-9b38-761ea11bdf03" status: 202 len: 0 microversion: 2.1 time: 0.267466 Aug 07 10:58:55.550229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 300/600] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 10:58:55 2022] DELETE /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57/os-volume_attachments/ccaae87d-a1c4-4ffb-9b38-761ea11bdf03 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 10:58:56.189567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:56.190172 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:56.196996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:56.197466 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:56.197893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:56.198575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:56.199623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:56.199998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:56.208871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:56.209576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:56.217207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:56.217691 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:56.218128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:56.218857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:56.219352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:56.219800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:56.421028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:56.425888 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:56.429764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:56.431283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:56.432563 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-57925805-dc3a-4c0c-a5a8-1161e80f6282 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.228678 Aug 07 10:58:56.433123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 301/601] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:56 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:56.433801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-132ec669-ef0d-41df-9d3c-04d54dfd41a8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.248020 Aug 07 10:58:56.434366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 301/602] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:56 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:57.455445 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:57.456130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:57.457977 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:57.459148 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:57.462840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:57.463356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:57.463793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:57.464604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:57.465149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:57.465570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:57.468169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:57.468836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:57.469440 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:57.470345 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:57.470795 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:57.471413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:57.677770 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:57.687812 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:57.689304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:57.690584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-91e7c9db-4d24-43f9-80d7-157aee4bdcf0 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.238141 Aug 07 10:58:57.691173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 302/603] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:57 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:58:57.693177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:57.702655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fde869f3-3788-4525-9769-029bd6765490 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.251410 Aug 07 10:58:57.703264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 302/604] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:57 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:58:58.713079 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:58.713598 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:58.720435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:58.720910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:58.721339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:58.722020 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:58.722462 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:58.722877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:58.724383 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:58.724998 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:58.732090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:58.732578 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:58.733271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:58.733963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:58.734418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:58.734841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:58.753698 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:58.921203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:58.929498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:58.931027 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:58.932200 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4c6617d5-2d6a-4fb0-85e6-a1a24e129f97 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.223094 Aug 07 10:58:58.932760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 303/605] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:58 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:58:58.965132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:58:58.973042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b44afb0c-7c29-4cfb-9861-5d445a8ab5c9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.252486 Aug 07 10:58:58.973608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 303/606] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:58 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:58:59.955888 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:59.956513 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:58:59.962835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:59.963342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:59.963769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:59.965043 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:58:59.965497 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:58:59.966158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:58:59.994317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:58:59.995028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:00.002104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:00.002583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:00.003116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:00.003808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:00.004258 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:00.004674 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:00.149952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:00.159281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:00.160786 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:00.162376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3564ff42-dd2f-454f-94cb-368371228f39 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.209991 Aug 07 10:59:00.178593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 304/607] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:58:59 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:00.195119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:00.204679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1601655c-7535-4d1f-883f-aa4f99e7779a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.214011 Aug 07 10:59:00.205629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 304/608] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:58:59 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:01.186914 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:01.188117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:01.193934 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:01.194411 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:01.194842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:01.195545 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:01.195993 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:01.196412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:01.226320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:01.226946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:01.234339 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:01.234820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:01.235292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:01.235991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:01.236446 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:01.236867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:01.384196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:01.395679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:01.397620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:01.398878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-819a807e-aa20-457f-a823-79ab975ca0de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.216496 Aug 07 10:59:01.399809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 305/609] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:01 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:01.441744 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:01.453055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d8acf77b-d05c-49f6-9056-c9c643d0cd5a tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.230413 Aug 07 10:59:01.465543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 305/610] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:01 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:02.422205 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:02.422813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:02.428982 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:02.429461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:02.429890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:02.430576 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:02.431120 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:02.431544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:02.477813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:02.477813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:02.485421 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:02.486345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:02.487032 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:02.488166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:02.489100 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:02.489752 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:02.876116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:02.884705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:02.886784 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:02.887972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2523b152-85be-48f5-b20d-b8b260459bbf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.470400 Aug 07 10:59:02.891685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:02.893690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 306/611] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:02 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:02.899531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b811aeed-fb4b-42a5-8a2f-8417aecd45f5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.427315 Aug 07 10:59:02.900260 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 306/612] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:02 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:03.910325 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:03.910957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:03.918247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:03.918759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:03.919233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:03.919975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:03.920436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:03.920867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:03.921077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:03.921694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:03.936427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:03.936939 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:03.937359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:03.938069 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:03.938523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:03.938962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:04.130588 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:04.143793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:04.145314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:04.146508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a7cade12-f839-4da9-9862-a35d61840655 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.240119 Aug 07 10:59:04.153140 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:04.159491 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 307/613] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:03 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:04.163243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1c1a129f-58d3-40aa-80b3-2a1fd32e155c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.246006 Aug 07 10:59:04.163926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 307/614] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:03 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:05.169375 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:05.169981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:05.176310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:05.176788 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:05.177217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:05.177895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:05.178341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:05.178763 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:05.187491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:05.188101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:05.194100 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:05.194693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:05.195169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:05.195855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:05.196303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:05.196745 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:05.381528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:05.390074 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:05.391615 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:05.392786 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-415fbf16-fa4b-44c9-ac32-9c0df233929e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.227796 Aug 07 10:59:05.393360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 308/615] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:05 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:05.445965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:05.468155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8bf623f9-0d49-46bb-8bfd-6b3819fdd43b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.285862 Aug 07 10:59:05.469079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 308/616] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:05 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:06.415668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:06.416277 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:06.423100 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:06.423535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:06.423971 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:06.424661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:06.425115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:06.425539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:06.491504 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:06.492117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:06.498378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:06.498868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:06.499336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:06.500024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:06.500477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:06.500896 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:06.678111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:06.686573 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:06.688106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:06.689261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b4aeff54-07a2-4598-bd28-a0d11dd22b1b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.277431 Aug 07 10:59:06.689817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 309/617] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:06 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:06.694580 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:06.703150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-78aad4c9-536b-44d5-a2b8-b5c5e1e8b025 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.215456 Aug 07 10:59:06.703707 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 309/618] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:06 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:07.712142 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:07.712757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:07.719819 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:07.720306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:07.720744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:07.721430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:07.721894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:07.722319 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:07.725731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:07.726341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:07.733511 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:07.733971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:07.734405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:07.735224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:07.735679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:07.736094 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:07.926766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:07.935567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:07.937064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:07.938226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a9346726-daff-4df4-ae74-a0561fdebeec tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.229983 Aug 07 10:59:07.938788 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 310/619] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:07 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:07.942784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:07.951630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ce6123a3-2bef-4e4b-a5f2-ce8644297f62 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.230514 Aug 07 10:59:07.952187 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 310/620] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:07 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:08.961208 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:08.961820 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:08.968773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:08.969263 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:08.969746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:08.970447 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:08.970904 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:08.971357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:08.973400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:08.974562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:08.983406 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:08.983890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:08.984319 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:08.985150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:08.985606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:08.986027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:09.184394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:09.192705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:09.194184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:09.195413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7f4e44bc-2bd3-4e07-aac3-fc9a126f2183 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.238185 Aug 07 10:59:09.196003 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 311/621] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:08 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:09.200230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:09.209114 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-86417c66-f44e-4393-b26a-26caff7507ae tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1755 microversion: 2.1 time: 0.239516 Aug 07 10:59:09.209753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 311/622] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:08 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:10.218232 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:10.218835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:10.225197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:10.225671 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:10.226096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:10.226772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:10.227248 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:10.227663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:10.230204 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:10.230811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:10.237325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:10.237797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:10.238223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:10.238902 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:10.239454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:10.239870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:10.425777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:10.434503 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:10.436033 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:10.437195 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-99805947-7c6b-47ff-976f-e610cd5afe6c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.223494 Aug 07 10:59:10.437755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 312/623] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:10 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:10.447078 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:10.455826 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d39b88ee-c53b-4d70-9c3b-69b4234723c5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1758 microversion: 2.1 time: 0.229397 Aug 07 10:59:10.456399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 312/624] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:10 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:11.459818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:11.460421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:11.466988 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:11.467471 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:11.467902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:11.468588 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:11.469041 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:11.470057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:11.602402 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:11.611704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:11.613206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:11.614363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2b2d3541-6515-4868-9295-8a6e87796c84 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.158379 Aug 07 10:59:11.614942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 313/625] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:11 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:12.637554 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:12.638165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:12.644606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:12.645089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:12.645524 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:12.646243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:12.646708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:12.647159 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:12.783108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:12.791515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:12.794273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:12.795557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-902fa55b-b72c-4cfb-add4-89c3ad544f61 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.161931 Aug 07 10:59:12.796128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 313/626] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:12 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:13.658002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:13.658502 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:13.664771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:13.665242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:13.665671 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:13.666347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:13.666791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:13.667825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:13.691858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 10:59:13.735441 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:13.752537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=48 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:13.768654 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c78a289d-1154-418a-b6e1-08cb8d1f94d0 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 204 len: 0 microversion: 2.1 time: 0.114026 Aug 07 10:59:13.769956 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 314/627] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 10:59:13 2022] DELETE /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 10:59:13.778731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:13.779354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:13.781615 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=48 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:13.786645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:13.787183 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:13.787613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:13.788290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:13.788738 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:13.789154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:13.818029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:13.818729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:13.824860 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:13.825340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:13.825772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:13.826510 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:13.826977 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:13.827400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:13.978536 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:13.986307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5442c762-14c5-4f54-9f57-b7da0395c3e7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1514 microversion: 2.1 time: 0.212099 Aug 07 10:59:13.986874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 314/628] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:13 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:14.005981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:14.015203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:14.016693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:14.017923 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e956023a-7664-44ad-b553-7eb5171430a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.204013 Aug 07 10:59:14.018478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 315/629] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:13 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:15.006763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:15.007396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:15.015256 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:15.015739 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:15.016171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:15.016861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:15.017314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:15.017734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:15.040164 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:15.040778 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:15.047578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:15.048069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:15.048507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:15.049199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:15.049656 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:15.050084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:15.224792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:15.230784 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:15.232584 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-53e2520f-1ee5-4112-a93f-d0634d0ca2a8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1514 microversion: 2.1 time: 0.229610 Aug 07 10:59:15.233425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 315/630] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:15 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:15.239502 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:15.241008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:15.242160 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-52983768-785b-4bf7-b226-98bca3b54105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.205888 Aug 07 10:59:15.242712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 316/631] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:15 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:16.254520 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:16.255294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:16.265109 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:16.265722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:16.270973 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:16.271678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:16.272117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:16.272357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:16.272820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:16.272933 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:16.273271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:16.273499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:16.273863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:16.274291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:16.274746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:16.275229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:16.370486 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:16.380673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5e09f5f0-35aa-4d77-aa38-9c2a8ff1d6a9 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 200 len: 1472 microversion: 2.1 time: 0.130157 Aug 07 10:59:16.383983 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 316/632] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:16 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 1472 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:16.416009 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-aa629e5e-21e5-47df-a0d7-67d19cfb628b req-d28d8732-180f-47a1-8933-c04acd16eaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5805b3b-d299-4071-ab05-6bc4d3f96c57", "name": "network-vif-deleted", "tag": "67fcb7ee-9dcd-4c2b-a605-f9ec372a3f96"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:16.429648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-aa629e5e-21e5-47df-a0d7-67d19cfb628b req-d28d8732-180f-47a1-8933-c04acd16eaa7 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:16.430209 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-aa629e5e-21e5-47df-a0d7-67d19cfb628b req-d28d8732-180f-47a1-8933-c04acd16eaa7 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:16.430702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-aa629e5e-21e5-47df-a0d7-67d19cfb628b req-d28d8732-180f-47a1-8933-c04acd16eaa7 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:16.441985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-aa629e5e-21e5-47df-a0d7-67d19cfb628b req-d28d8732-180f-47a1-8933-c04acd16eaa7 service nova] Creating event network-vif-deleted:67fcb7ee-9dcd-4c2b-a605-f9ec372a3f96 for instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 on hv-cinder-85032 Aug 07 10:59:16.447216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-aa629e5e-21e5-47df-a0d7-67d19cfb628b req-d28d8732-180f-47a1-8933-c04acd16eaa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035847 Aug 07 10:59:16.447809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 317/633] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:16.452926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:16.461833 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:16.463376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:16.465080 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c5de43f0-9f3b-4fd1-8c5c-284dcf32d055 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.204094 Aug 07 10:59:16.465637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 317/634] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:16 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:17.202434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 10:59:17.202645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 10:59:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 10:59:17.406872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:17.407734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: a5805b3b-d299-4071-ab05-6bc4d3f96c57] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:17.413899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:17.414377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:17.414806 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:17.415548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:17.416024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:17.416443 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:17.430251 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] HTTP exception thrown: Instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 could not be found. Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Request method failure captured: Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 HTTP/1.1 Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75qk5ZOKG3xyn6fkr1jXeyINPmT_YuhKfQIa0h9tf7whUf8vtwS8u4JZAObWth81WwJGPuRN5ehu042fnYxnVt-FlCBsBuoqi-R2OQNBVe5NWysu7waXaFK0MS4YUJaXxEd7sMjGXHqFpsojTMm6vyqS1bjZBpXrqnIgv-05X3_gWrg Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 81ab48958e894bdbb5cd46049356a8a0 Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1183292982 Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 10:59:17.431880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81ab48958e894bdbb5cd46049356a8a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81ab48958e894bdbb5cd46049356a8a0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81ab48958e894bdbb5cd46049356a8a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81ab48958e894bdbb5cd46049356a8a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotTestJSON-1183292982 Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 81ab48958e894bdbb5cd46049356a8a0 Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1183292982 Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotTestJSON-1183292982-project Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c4597d928ad24b6c81420f7158e5e98b Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotTestJSON-1183292982-project Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 could not be found. Aug 07 10:59:17.434336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': 'a5805b3b-d299-4071-ab05-6bc4d3f96c57'} Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 could not be found. Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 10:59:17.435308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 could not be found. Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 could not be found. Aug 07 10:59:17.437262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 10:59:17.438600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Returning 404 to user: Instance a5805b3b-d299-4071-ab05-6bc4d3f96c57 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 10:59:17.438600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c8281550-b11b-49c9-a7df-932c4377cf1b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57" status: 404 len: 111 microversion: 2.1 time: 0.031944 Aug 07 10:59:17.438600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 318/635] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:17 2022] GET /compute/v2.1/servers/a5805b3b-d299-4071-ab05-6bc4d3f96c57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 10:59:17.487646 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:17.488267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:17.494530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:17.495049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:17.496148 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:17.496839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:17.497296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:17.497719 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:17.641983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:17.650433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:17.652537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:17.653738 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fc2fef57-2390-4d00-bc6b-7c3cd6267eb1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.170037 Aug 07 10:59:17.654300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 318/636] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:17 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:18.676002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:18.676621 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:18.683455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:18.683926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:18.684352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:18.685026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:18.685472 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:18.685886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:18.814890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:18.823815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:18.825892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:18.827068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d77c2bd0-da5a-4071-83c9-2dff0f476435 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.154837 Aug 07 10:59:18.827622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 319/637] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:18 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:19.849652 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:19.850252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:19.856707 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:19.857187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:19.857620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:19.858606 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:19.859101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:19.859530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:19.924181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:19.924709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:19.931133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:19.931596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:19.932025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:19.933267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:19.933718 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:19.934131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:19.958515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d50d1ce3-03c2-4118-b11f-1871a2994251 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/ips" status: 200 len: 150 microversion: 2.1 time: 0.038212 Aug 07 10:59:19.959127 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 320/638] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 10:59:19 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:59:19.993334 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:20.002371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:20.003882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:20.005032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b029e4a6-b81c-43fe-876f-ca99c3d31729 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.159264 Aug 07 10:59:20.005584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 319/639] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:19 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:21.130783 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:21.131427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:21.137767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:21.138216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:21.138640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:21.139345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:21.139793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:21.140292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:21.268866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:21.272518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:21.279747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:21.281314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:21.282447 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-38b1ca81-58ed-45da-b0a2-90e96495da59 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.258231 Aug 07 10:59:21.283022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 321/640] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:21 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:22.237586 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 10:59:22.238117 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 10:59:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 10:59:22.304903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:22.305504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:22.311821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:22.312296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:22.312720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:22.313400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:22.313844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:22.314261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:22.447696 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:22.456554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:22.458043 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:22.459231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-30d53ac1-59b3-408b-b9a4-8b0e9a9819c1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.158085 Aug 07 10:59:22.459787 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 320/641] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:22 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:23.423596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9a00ee-17f1-4b9f-b89e-22571da59c98"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:23.426040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:23.432511 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:23.432996 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:23.433437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:23.434794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:23.435290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:23.435715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:23.483071 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:23.483776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:23.489840 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:23.490314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:23.490741 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:23.491445 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:23.491894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:23.492314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:23.631869 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:23.640217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:23.641791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:23.642953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0a1fe14c-dde3-41f0-abf7-7b54671c31de tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.164572 Aug 07 10:59:23.643493 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 321/642] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:23 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:23.793947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0a3f193c-e6b9-46a4-9534-f6a4a4866728 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373470 Aug 07 10:59:23.794716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 322/643] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:59:23 2022] POST /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:24.665677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:24.666210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:24.672764 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:24.673241 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:24.673700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:24.674382 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:24.674830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:24.675284 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:24.803253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:24.812001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:24.813471 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:24.814607 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9afc1030-75cf-49a1-989b-0a68471b0909 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.152860 Aug 07 10:59:24.815199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 322/644] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:24 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:25.838746 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:25.839465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:25.846194 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:25.846681 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:25.847142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:25.847824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:25.848272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:25.848689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:25.984823 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:25.993190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:25.994709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:25.995895 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1771e6c4-78fc-4029-bd84-f1321098f063 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.161899 Aug 07 10:59:25.996641 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 323/645] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:25 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:27.018287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:27.018899 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:27.025315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:27.025794 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:27.026232 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:27.026964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:27.027437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:27.028490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:27.156326 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:27.164563 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:27.166061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:27.167264 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8606679a-7790-4c0b-87fd-388093937f67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.152722 Aug 07 10:59:27.167816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 323/646] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:27 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:28.188946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:28.189552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:28.196207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:28.196688 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:28.197121 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:28.197805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:28.198259 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:28.198683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:28.327130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:28.335658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:28.337172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:28.338338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f45d72d4-c5ec-4b56-aee6-263795cd4711 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.153297 Aug 07 10:59:28.338893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 324/647] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:28 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:29.362576 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:29.363213 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:29.369972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:29.370457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:29.370883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:29.372225 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:29.372676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:29.373239 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:29.430890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-326596154", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "networks": [{"uuid": "efdedc16-3f87-4497-963e-dce0a10e25cb"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:29.492254 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] validate_networks() for [('efdedc16-3f87-4497-963e-dce0a10e25cb', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:59:29.616761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:29.625160 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:29.626640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:29.627818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9c0bb585-b963-498e-9bc8-7795fbfbaab4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.269708 Aug 07 10:59:29.628367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 324/648] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:29 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:29.931321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:59:29.931747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:59:29.932225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:59:29.932632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:59:29.933043 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:59:29.942181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:29.942658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:29.943136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:29.943863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:29.944315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:29.944735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:29.961890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Getting quotas for project 81ab48958e894bdbb5cd46049356a8a0. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:59:29.966685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Getting quotas for user c4597d928ad24b6c81420f7158e5e98b and project 81ab48958e894bdbb5cd46049356a8a0. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:59:29.977368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:59:29.979651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:59:30.025060 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eb63d186-b4a7-4e54-959d-7cfac101aa4a tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598528 Aug 07 10:59:30.025705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 325/649] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:59:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 10:59:30.037004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dccdf720-1357-4ef0-b94a-3746be3da4e3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:30.037752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dccdf720-1357-4ef0-b94a-3746be3da4e3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:30.090811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dccdf720-1357-4ef0-b94a-3746be3da4e3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:30.097743 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dccdf720-1357-4ef0-b94a-3746be3da4e3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1218 microversion: 2.1 time: 0.064361 Aug 07 10:59:30.107490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 325/650] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:30 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:30.255292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-2de8f0cb-58a6-4773-8b1a-8773b97475a1 req-f0142dcb-e6e2-4a9b-a642-ba53f9b37d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ec2284-c34f-4e70-b19f-4e762542600e", "name": "network-vif-plugged", "status": "completed", "tag": "90ed1281-54b7-4284-9826-dc980d8a465a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:30.267288 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2de8f0cb-58a6-4773-8b1a-8773b97475a1 req-f0142dcb-e6e2-4a9b-a642-ba53f9b37d55 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:30.267822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2de8f0cb-58a6-4773-8b1a-8773b97475a1 req-f0142dcb-e6e2-4a9b-a642-ba53f9b37d55 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:30.268128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2de8f0cb-58a6-4773-8b1a-8773b97475a1 req-f0142dcb-e6e2-4a9b-a642-ba53f9b37d55 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:30.280531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-2de8f0cb-58a6-4773-8b1a-8773b97475a1 req-f0142dcb-e6e2-4a9b-a642-ba53f9b37d55 service nova] Creating event network-vif-plugged:90ed1281-54b7-4284-9826-dc980d8a465a for instance 72ec2284-c34f-4e70-b19f-4e762542600e on hv-cinder-85032 Aug 07 10:59:30.285715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-2de8f0cb-58a6-4773-8b1a-8773b97475a1 req-f0142dcb-e6e2-4a9b-a642-ba53f9b37d55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034376 Aug 07 10:59:30.286622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 326/651] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:30.651097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:30.651701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:30.658262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:30.658732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:30.659194 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:30.659905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:30.660353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:30.660822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:30.789805 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:30.798738 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:30.800255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:30.801396 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-96a63a18-c1d1-4528-8923-555f0d12318b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.154303 Aug 07 10:59:30.801956 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 326/652] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:30 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:31.120273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:31.121118 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:31.127811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:31.128414 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:31.128934 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:31.129705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:31.130239 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:31.130753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:31.193809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:31.201278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bfd5e786-394c-4c4e-862e-50635eb046e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1270 microversion: 2.1 time: 0.086285 Aug 07 10:59:31.201843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 327/653] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:31 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:31.826983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:31.827586 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:31.833871 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:31.834343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:31.834770 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:31.835496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:31.835947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:31.836363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:31.963145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:31.971535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:31.973034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:31.974192 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7e7ce636-ce96-4804-b31c-e78f82b7ad9a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.151990 Aug 07 10:59:31.974750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 327/654] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:31 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:32.221736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:32.222383 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:32.228911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:32.229388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:32.229902 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:32.231543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:32.232180 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:32.232637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:32.299526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:32.306800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-036c8b48-b28f-4cb0-93db-12460adb1e8d tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1278 microversion: 2.1 time: 0.089006 Aug 07 10:59:32.307402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 328/655] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:32 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:32.553570 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e40f40c2-0cde-422c-a16b-b203192c1230"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:32.556013 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:32.562722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:32.563247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:32.563691 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:32.564379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:32.564839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:32.565265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:32.997192 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:32.997797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:33.003739 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:33.004225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:33.004656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:33.005346 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:33.005802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:33.006224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:33.145706 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:33.156170 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:33.158226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:33.159790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f408c11a-3b40-41b5-9633-6552905f326f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.166704 Aug 07 10:59:33.160441 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 329/656] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:32 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:33.270823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8aea1359-b016-4fac-8349-0460cfc11f7b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825676 Aug 07 10:59:33.276757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 328/657] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:59:32 2022] POST /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 10:59:33.329482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:33.330366 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:33.337202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:33.337758 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:33.338332 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:33.339105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:33.339564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:33.340068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:33.404358 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:33.413804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2802e687-8d1f-4516-bdf8-a1455a43f110 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1276 microversion: 2.1 time: 0.088168 Aug 07 10:59:33.414914 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 330/658] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:33 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:34.186126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:34.187542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:34.193403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:34.193881 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:34.194317 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:34.195061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:34.195517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:34.195939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:34.328322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:34.336532 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:34.338175 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:34.339194 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db18666e-08fb-498b-898c-84a2aa549a4e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1808 microversion: 2.20 time: 0.158624 Aug 07 10:59:34.340486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 329/659] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:34 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 10:59:34.434066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:34.434680 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:34.442578 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:34.443163 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:34.443619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:34.444264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:34.444767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:34.446589 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:34.584279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:34.592376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c71059e0-6ee3-44b3-bef6-6fc701f20324 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.162313 Aug 07 10:59:34.592948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 331/660] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:34 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:34.939644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e4ef0882-72ad-41ed-86ec-d0cc60237d64 req-7cdab660-10d0-45e1-b08b-65114c55852d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c11e5ef-6384-4377-8b51-992b11842e5f", "tag": "32fb0d5c-9cd2-40e0-8860-d31268592bae"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:34.949388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e4ef0882-72ad-41ed-86ec-d0cc60237d64 req-7cdab660-10d0-45e1-b08b-65114c55852d service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:34.950026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e4ef0882-72ad-41ed-86ec-d0cc60237d64 req-7cdab660-10d0-45e1-b08b-65114c55852d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:34.950457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e4ef0882-72ad-41ed-86ec-d0cc60237d64 req-7cdab660-10d0-45e1-b08b-65114c55852d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:34.961141 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e4ef0882-72ad-41ed-86ec-d0cc60237d64 req-7cdab660-10d0-45e1-b08b-65114c55852d service nova] Creating event network-changed:32fb0d5c-9cd2-40e0-8860-d31268592bae for instance 3c11e5ef-6384-4377-8b51-992b11842e5f on hv-cinder-85032 Aug 07 10:59:34.966504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e4ef0882-72ad-41ed-86ec-d0cc60237d64 req-7cdab660-10d0-45e1-b08b-65114c55852d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030571 Aug 07 10:59:34.967116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 330/661] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:35.361875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:35.362487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:35.368588 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:35.369085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:35.369517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:35.370208 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:35.370670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:35.371284 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:35.520050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:35.530245 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:35.531785 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:35.532949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7f468631-39a6-4fb7-b6b5-e0f54e07c56a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1795 microversion: 2.20 time: 0.175303 Aug 07 10:59:35.533695 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 332/662] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 10:59:35 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1795 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 10:59:35.613772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:35.614715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:35.625218 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:35.625699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:35.626128 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:35.626812 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:35.627291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:35.627707 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:35.647687 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:35.763480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:35.770834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-97adda54-9ade-44fb-8ead-46c23804cca7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.161661 Aug 07 10:59:35.771441 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 331/663] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:35 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:36.683569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a6a946d9-afd4-4a30-b283-3193efd3d97b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: .version_select at 0x7fc5ed82c1f0>, body: {"keypair": {"name": "tempest-keypair-2142719322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPakpCuNJvNEWg/lf5kuW1kB43aLXHAiXLDpeSESepMegaXu3aIkYbMzY8smESkkPGyXPuslI03y1AWIFjiN77JglRNg2ONzYjGARkbiMkCIuRWuKKjRQ7nHHociv2z4QQ=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:36.699781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a6a946d9-afd4-4a30-b283-3193efd3d97b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:59:36.703631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a6a946d9-afd4-4a30-b283-3193efd3d97b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:59:36.725846 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a6a946d9-afd4-4a30-b283-3193efd3d97b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047824 Aug 07 10:59:36.726608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 333/664] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 10:59:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:36.791224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:36.791843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:36.798294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:36.799051 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:36.799715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:36.800476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:36.801009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:36.801349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:36.938278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:36.945714 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-18dc50b2-e9e8-468d-b565-913b511ee05e tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.158359 Aug 07 10:59:36.946281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 332/665] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:36 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:37.966882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:37.967440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:37.974957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:37.975433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:37.975865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:37.976566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:37.977086 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:37.977515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:37.982470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-49862898", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a58cdcc4-38d5-4381-93af-404135fb0ce7"}], "security_groups": [{"name": "tempest-securitygroup--507351146"}], "key_name": "tempest-keypair-2142719322", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:38.114130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] validate_networks() for [('a58cdcc4-38d5-4381-93af-404135fb0ce7', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 10:59:38.187101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:38.194546 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7f468abd-cda1-4028-975f-3a1c9f64b61c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.231603 Aug 07 10:59:38.195134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 334/666] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:37 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:38.535863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 10:59:38.536318 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 10:59:38.536817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 10:59:38.537229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 10:59:38.537638 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 10:59:38.546748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:38.547260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:38.547695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:38.548415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:38.548866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:38.549289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:38.566419 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 10:59:38.570341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 10:59:38.582549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 10:59:38.584835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 10:59:38.632612 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e254ad98-fbcf-4e4a-b361-1df4811c4d68 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.654502 Aug 07 10:59:38.633255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 333/667] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 10:59:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 10:59:38.644636 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a5983b43-4ec9-4919-ac12-0b051ceb76ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:38.645242 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a5983b43-4ec9-4919-ac12-0b051ceb76ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:38.700089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a5983b43-4ec9-4919-ac12-0b051ceb76ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:38.707646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a5983b43-4ec9-4919-ac12-0b051ceb76ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1240 microversion: 2.1 time: 0.066931 Aug 07 10:59:38.708211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 335/668] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:38 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:39.217299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:39.217838 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:39.224877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:39.225353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:39.225780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:39.226457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:39.226906 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:39.227347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:39.355748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:39.363458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b4b0112c-a9dc-467f-9e67-3eb1d62b7f00 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.150590 Aug 07 10:59:39.364023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 334/669] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:39 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:39.727485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:39.728098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:39.735471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:39.735953 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:39.736386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:39.737074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:39.737528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:39.737953 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:39.797257 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:39.804625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9b8b1bab-bb92-4ca8-accf-3f447d1a0ea2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1244 microversion: 2.1 time: 0.080992 Aug 07 10:59:39.805187 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 336/670] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:39 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:40.383906 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:40.384510 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:40.391724 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:40.392211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:40.392637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:40.393326 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:40.393774 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:40.394189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:40.530992 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:40.538682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bcea1627-76d8-4b33-9b6a-4ceff39236e4 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.158635 Aug 07 10:59:40.539266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 335/671] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:40 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:40.826107 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:40.826761 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:40.828789 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:40.834536 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:40.835053 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:40.835493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:40.836198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:40.836657 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:40.837086 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:40.904136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:40.911909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a79f80a1-c1b8-4426-8049-6e705bc1c495 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1300 microversion: 2.1 time: 0.090515 Aug 07 10:59:40.912491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 337/672] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:40 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:41.560604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:41.561314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:41.567615 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:41.568097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:41.568527 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:41.569215 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:41.569667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:41.570099 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:41.701882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:41.709361 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7ab9d19c-2931-4467-b3f0-e19847f06fe5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.153638 Aug 07 10:59:41.709928 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 336/673] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:41 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:41.932326 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:41.932940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:41.940429 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:41.940916 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:41.941353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:41.942059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:41.942512 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:41.942952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:42.090097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:42.098142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-28c03386-2960-4a06-9068-3535841079eb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.169662 Aug 07 10:59:42.098731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 338/674] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:41 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:42.597420 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2dc787c4-510c-49be-85ba-e8c396de71bf req-9cb0d468-3b21-4ab4-b709-2e6908ba05e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c11e5ef-6384-4377-8b51-992b11842e5f", "name": "network-vif-plugged", "status": "completed", "tag": "32fb0d5c-9cd2-40e0-8860-d31268592bae"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:42.607510 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2dc787c4-510c-49be-85ba-e8c396de71bf req-9cb0d468-3b21-4ab4-b709-2e6908ba05e8 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:42.608463 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2dc787c4-510c-49be-85ba-e8c396de71bf req-9cb0d468-3b21-4ab4-b709-2e6908ba05e8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:42.608889 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2dc787c4-510c-49be-85ba-e8c396de71bf req-9cb0d468-3b21-4ab4-b709-2e6908ba05e8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:42.620525 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2dc787c4-510c-49be-85ba-e8c396de71bf req-9cb0d468-3b21-4ab4-b709-2e6908ba05e8 service nova] Creating event network-vif-plugged:32fb0d5c-9cd2-40e0-8860-d31268592bae for instance 3c11e5ef-6384-4377-8b51-992b11842e5f on hv-cinder-85032 Aug 07 10:59:42.626468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2dc787c4-510c-49be-85ba-e8c396de71bf req-9cb0d468-3b21-4ab4-b709-2e6908ba05e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033022 Aug 07 10:59:42.627651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 337/675] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:42.710280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-f1ff82b6-8e9e-40cd-b4ee-283ef0ad78c3 req-8bfa4f26-1552-46af-9ae5-78e24fda769b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5389db54-ca87-4ac8-878c-08eddf5676dd", "tag": "cc0d1fc5-e58e-4e21-800b-9ea5222c59d2"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:42.719725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-f1ff82b6-8e9e-40cd-b4ee-283ef0ad78c3 req-8bfa4f26-1552-46af-9ae5-78e24fda769b service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:42.720198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-f1ff82b6-8e9e-40cd-b4ee-283ef0ad78c3 req-8bfa4f26-1552-46af-9ae5-78e24fda769b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:42.720620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-f1ff82b6-8e9e-40cd-b4ee-283ef0ad78c3 req-8bfa4f26-1552-46af-9ae5-78e24fda769b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:42.730968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:42.731655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:42.731941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-f1ff82b6-8e9e-40cd-b4ee-283ef0ad78c3 req-8bfa4f26-1552-46af-9ae5-78e24fda769b service nova] Creating event network-changed:cc0d1fc5-e58e-4e21-800b-9ea5222c59d2 for instance 5389db54-ca87-4ac8-878c-08eddf5676dd on hv-cinder-85032 Aug 07 10:59:42.737280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-f1ff82b6-8e9e-40cd-b4ee-283ef0ad78c3 req-8bfa4f26-1552-46af-9ae5-78e24fda769b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094097 Aug 07 10:59:42.737863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 339/676] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:42.738476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:42.738989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:42.739549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:42.740260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:42.740809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:42.746609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:42.899780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:42.907288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e8c5f4ba-7aeb-4bfd-b4c2-ca3bb58c6ab1 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.181037 Aug 07 10:59:42.907854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 338/677] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:42 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:43.120688 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:43.121566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:43.127701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:43.128188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:43.128629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:43.129318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:43.129775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:43.130204 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:43.262128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:43.269591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9d7a3e54-2b43-461a-99d8-c9cced890368 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.153735 Aug 07 10:59:43.270155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 340/678] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:43 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:43.927556 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:43.928172 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:43.930716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:43.938597 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:43.939168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:43.939651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:43.940388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:43.940842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:43.941264 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:44.071355 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:44.079371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-002295fe-9c8e-4307-bcb9-a6dde5f729d5 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.155613 Aug 07 10:59:44.079935 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 339/679] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:43 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:44.289478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:44.290082 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:44.293019 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:44.298870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:44.299386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:44.299818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:44.300508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:44.300997 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:44.301428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:44.306315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:44.432901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:44.441288 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-679f5883-0d78-443b-b023-053f53adbeea tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.155617 Aug 07 10:59:44.441842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 341/680] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:44 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:45.099857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:45.100458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:45.106915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:45.107412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:45.108086 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:45.108775 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:45.109222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:45.109737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:45.452707 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:45.460188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-66d2f540-d868-4dc6-bb21-4b4ce0eb41fc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.364173 Aug 07 10:59:45.460782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 340/681] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:45 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:45.462068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:45.462691 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:45.469178 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:45.469660 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:45.470097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:45.470790 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:45.471400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:45.471827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:45.598839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:45.606310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-82238970-612c-4d8c-b941-221193f8b628 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.148440 Aug 07 10:59:45.607004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 342/682] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:45 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:46.480476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:46.481088 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:46.487751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:46.488231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:46.488662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:46.489349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:46.489803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:46.490226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:46.617696 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:46.625103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-af8641c5-1169-4d5a-9771-d49c55b8251c tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.148510 Aug 07 10:59:46.625664 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 341/683] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:46 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:46.626747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:46.627403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:46.633705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:46.634183 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:46.634612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:46.635325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:46.635782 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:46.636725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:46.763488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:46.770818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-24cb2f0b-cfe4-4a7c-b06e-47ad00f92c46 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.147788 Aug 07 10:59:46.771405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 343/684] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:46 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:47.645673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:47.646289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:47.653615 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:47.654097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:47.654529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:47.655239 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:47.655694 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:47.656115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:47.790058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:47.792036 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:47.793261 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:47.798403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a30c6e58-d8cd-4eb3-9c5e-3b44fcc920c3 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1318 microversion: 2.1 time: 0.156522 Aug 07 10:59:47.798994 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 342/685] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:47 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:47.799611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:47.800175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:47.800606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:47.801289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:47.801735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:47.802149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:47.930158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:47.937588 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-56c77a7b-8baa-461a-a389-cd21b25af35f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.149404 Aug 07 10:59:47.938162 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 344/686] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:47 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:48.819201 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:48.819835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:48.821632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:48.822269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=8 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:48.828000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:48.828477 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:48.828902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:48.829586 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:48.830037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:48.830452 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:48.960378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:48.961427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:48.963593 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=12 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:48.968230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:48.969936 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:48.970424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:48.970852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:48.971580 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:48.972178 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:48.972608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:48.983528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8ce7078d-fe2d-4d39-a7ad-b8291d5bbbdc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1508 microversion: 2.1 time: 0.167768 Aug 07 10:59:48.984246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 343/687] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:48 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:49.004822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ef49f2-a370-485e-8f98-510a14f975fe", "device": "/dev/sdb"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:49.007747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:49.013744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:49.014220 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:49.014844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:49.015566 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:49.016011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:49.016425 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:49.111400 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:49.118666 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5f95c434-720f-4602-8915-cd1c5ffab6cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.163077 Aug 07 10:59:49.119323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 345/688] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:48 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:50.139743 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:50.140425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:50.146725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:50.147236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:50.147671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:50.148463 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:50.148945 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:50.149374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:50.291268 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:50.301398 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-18a149ec-7c3c-49f1-bf1c-210a99138f40 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.166364 Aug 07 10:59:50.301964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 346/689] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:50 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:50.427336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-430aac34-aaaa-4025-93ae-51bc1c102041 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "POST /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.426090 Aug 07 10:59:50.427940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 344/690] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 10:59:48 2022] POST /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f/os-volume_attachments => generated 194 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:51.027598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-eb482be7-c11c-42c4-937e-84d4074113ee req-4439b261-065f-44f7-a0f7-e082721d5d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5389db54-ca87-4ac8-878c-08eddf5676dd", "name": "network-vif-plugged", "status": "completed", "tag": "cc0d1fc5-e58e-4e21-800b-9ea5222c59d2"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:51.037359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-eb482be7-c11c-42c4-937e-84d4074113ee req-4439b261-065f-44f7-a0f7-e082721d5d1f service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:51.037891 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-eb482be7-c11c-42c4-937e-84d4074113ee req-4439b261-065f-44f7-a0f7-e082721d5d1f service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:51.038304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-eb482be7-c11c-42c4-937e-84d4074113ee req-4439b261-065f-44f7-a0f7-e082721d5d1f service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:51.049330 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-eb482be7-c11c-42c4-937e-84d4074113ee req-4439b261-065f-44f7-a0f7-e082721d5d1f service nova] Creating event network-vif-plugged:cc0d1fc5-e58e-4e21-800b-9ea5222c59d2 for instance 5389db54-ca87-4ac8-878c-08eddf5676dd on hv-cinder-85032 Aug 07 10:59:51.054238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-eb482be7-c11c-42c4-937e-84d4074113ee req-4439b261-065f-44f7-a0f7-e082721d5d1f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085608 Aug 07 10:59:51.054834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 347/691] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 10:59:51.322716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:51.324186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:51.330905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:51.331461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:51.331920 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:51.332807 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:51.333570 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:51.334000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:51.417902 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 10:59:51.420424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:51.427822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:51.428308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:51.428741 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:51.429434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:51.429886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:51.430304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:51.453961 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lazy-loading 'flavor' on Instance uuid edf03e0d-d4df-471c-a17e-db0ab8dbbc1f {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 10:59:51.474767 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:51.483679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8b420d39-9f65-4305-9dbf-4c0f8d06ea29 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.165210 Aug 07 10:59:51.491762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 345/692] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:51 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:51.577620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1c53b6fb-2826-4e1b-8189-0e3a63989a24 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/action" status: 200 len: 32 microversion: 2.1 time: 0.164211 Aug 07 10:59:51.578224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 348/693] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 10:59:51 2022] POST /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 10:59:51.587795 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:51.588400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:51.594945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:51.595435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:51.595888 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:51.596562 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:51.597035 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:51.597436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:51.725726 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:51.734568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e76075b7-bef1-4d88-9811-af578b231cdd tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.150648 Aug 07 10:59:51.735153 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 346/694] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:51 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:52.505316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:52.506014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:52.512250 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:52.512731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:52.513171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:52.513855 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:52.514308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:52.514726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:52.648468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:52.655985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3e1da8d6-c7a6-43f0-a08a-4b51d76abcb4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.155350 Aug 07 10:59:52.656552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 349/695] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:52 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:52.763971 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:52.764575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:52.770910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:52.771421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:52.771855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:52.772539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:52.773028 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:52.773449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:52.900702 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:52.909285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-825dbd7c-0423-4858-9a37-c6aea133f399 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.149259 Aug 07 10:59:52.909856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 347/696] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:52 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:53.676626 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:53.677169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:53.684048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:53.684520 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:53.684949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:53.685632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:53.686113 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:53.686527 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:53.814843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:53.822213 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c28a5ddd-a7a7-4b1c-8514-e9e82cdb930c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.149435 Aug 07 10:59:53.822776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 350/697] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:53 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:53.939224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:53.940113 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:53.951813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:53.952262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:53.952901 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:53.953841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:53.954304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:53.954728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:53.959892 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:54.093535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:54.101548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-92c1f45b-f697-4d37-a440-82cad4643a5e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.174502 Aug 07 10:59:54.102140 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 348/698] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:53 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:54.843036 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:54.843963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:54.850525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:54.851034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:54.851565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:54.852363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:54.852901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:54.853496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:55.003940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:55.011296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c7e01eca-ad59-4120-8445-d69553d1842f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.172213 Aug 07 10:59:55.011858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 351/699] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:54 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:55.122988 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:55.123599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:55.129905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:55.130380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:55.130805 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:55.131516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:55.131965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:55.132382 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:55.263304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:55.271056 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-06ba3ef2-da7c-40a5-8eaf-440dce73e286 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.152061 Aug 07 10:59:55.271611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 349/700] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:55 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:56.031989 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:56.032726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:56.039403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:56.039876 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:56.040305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:56.040992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:56.041467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:56.041879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:56.172760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:56.180120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f40bfb2b-ca63-4b17-8bbd-bc4a1d303002 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.152455 Aug 07 10:59:56.180682 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 352/701] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:56 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:56.292918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:56.293527 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:56.299819 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:56.300297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:56.300724 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:56.301401 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:56.301857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:56.302271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:56.434664 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:56.442663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a4bce2b7-a560-4caa-8063-52891c13627c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.154271 Aug 07 10:59:56.443264 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 350/702] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:56 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:57.200880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:57.201482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:57.207837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:57.208362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:57.208737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:57.209422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:57.209867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:57.210281 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:57.339879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:57.347315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1fb169c6-da6c-4f71-95df-6b1f00e78e1a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.150218 Aug 07 10:59:57.347893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 353/703] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:57 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 10:59:57.462942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:57.463508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:57.470345 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:57.470830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:57.471307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:57.471999 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:57.472455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:57.472877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:57.598947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:57.607445 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fe829b58-7c0e-49fc-9ee5-4ca478da7307 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.148394 Aug 07 10:59:57.608257 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 351/704] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:57 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:58.368645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:58.369317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:58.376679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:58.377156 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:58.377585 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:58.378270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:58.378720 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:58.379176 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:58.512231 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:58.519591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9297b26e-5de8-4cb2-a301-ddd1b5369759 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.154925 Aug 07 10:59:58.520144 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 354/705] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:58 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:58.628955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:58.629492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:58.635952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:58.636436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:58.636871 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:58.637560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:58.638016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:58.638442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:58.766548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:58.774292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4e01bcca-0e31-4d35-9d9d-39e08e14392d tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.149239 Aug 07 10:59:58.774852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 352/706] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:58 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:59.539915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:59.540525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:59.547253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:59.547735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:59.548169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:59.548851 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:59.549304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:59.549722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:59.687110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:59.695199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-201a7348-897a-438f-b977-be260815adfc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1365 microversion: 2.1 time: 0.159043 Aug 07 10:59:59.695823 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 355/707] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:59 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 10:59:59.795823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 10:59:59.796421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 10:59:59.802902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:59.803410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:59.803844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:59.804528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 10:59:59.804982 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 10:59:59.805404 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 10:59:59.934435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 10:59:59.942402 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fab78235-41b5-4588-9ab1-2babee3236f8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.150900 Aug 07 10:59:59.942902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 353/708] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 10:59:59 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:00.717898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:00.718462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:00.724880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:00.725506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:00.726065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:00.726819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:00.727303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:00.727726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:00.746763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:00.856316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:00.863971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7bde7310-027c-4e86-8dbb-b6b611ad1dab tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1555 microversion: 2.1 time: 0.151395 Aug 07 11:00:00.864539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 356/709] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:00 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:00.883818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:00.884306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:00.891181 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:00.891659 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:00.892087 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:00.892758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:00.893203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:00.893615 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:00.965118 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:00.965731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:00.971628 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:00.972119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:00.972577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:00.973255 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:00.973711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:00.974136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:00.974400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-11698693-c507-4ac1-9868-cd31a853ceba tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094379 Aug 07 11:00:00.975011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 354/710] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 11:00:00 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:00:01.253976 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:01.262704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a1f710e4-6afd-4d2c-9497-d64fb86ed437 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.302024 Aug 07 11:00:01.263312 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 357/711] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:00 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:00:02.023106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-0d4f33a2-4bf4-4be3-b923-316968977083 req-8f446cd9-d1bb-466a-b401-bc99b21253bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5389db54-ca87-4ac8-878c-08eddf5676dd", "tag": "cc0d1fc5-e58e-4e21-800b-9ea5222c59d2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:02.032891 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0d4f33a2-4bf4-4be3-b923-316968977083 req-8f446cd9-d1bb-466a-b401-bc99b21253bf service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:02.033371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0d4f33a2-4bf4-4be3-b923-316968977083 req-8f446cd9-d1bb-466a-b401-bc99b21253bf service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:02.033797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0d4f33a2-4bf4-4be3-b923-316968977083 req-8f446cd9-d1bb-466a-b401-bc99b21253bf service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:02.045563 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-0d4f33a2-4bf4-4be3-b923-316968977083 req-8f446cd9-d1bb-466a-b401-bc99b21253bf service nova] Creating event network-changed:cc0d1fc5-e58e-4e21-800b-9ea5222c59d2 for instance 5389db54-ca87-4ac8-878c-08eddf5676dd on hv-cinder-85032 Aug 07 11:00:02.050760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-0d4f33a2-4bf4-4be3-b923-316968977083 req-8f446cd9-d1bb-466a-b401-bc99b21253bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083592 Aug 07 11:00:02.051478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 355/712] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:02.284484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:02.285420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:02.294940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:02.295670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:02.298560 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:02.300801 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:02.301274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:02.301708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:02.465709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:02.474084 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5e3bf5f4-410b-465d-837a-4bc7a44ee92a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.193897 Aug 07 11:00:02.474661 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 358/713] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:02 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:03.496542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:03.497166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:03.503251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:03.503731 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:03.504898 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:03.505129 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:03.505579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:03.506002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:03.639533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:03.647391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9e068b5f-2cd9-4167-b161-3c1f070618e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.155573 Aug 07 11:00:03.647950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 356/714] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:03 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:04.668950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:04.669535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:04.676022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:04.676509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:04.676942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:04.677630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:04.678110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:04.678531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:04.813527 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:04.821342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2ca2e52b-a9ab-47b9-93bf-dc9476a8fa93 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.157332 Aug 07 11:00:04.821898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 359/715] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:04 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:05.841625 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:05.842271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:05.848670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:05.849145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:05.849579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:05.850261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:05.850715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:05.851166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:05.984722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:05.992668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-13d4b8a5-f493-49e5-9fc9-d3e3e10fb3d8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.155231 Aug 07 11:00:05.993233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 357/716] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:05 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:07.014263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:07.014879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:07.021046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:07.021538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:07.021977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:07.022666 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:07.023159 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:07.023588 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:07.152559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:07.160417 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-69bda015-6452-44e5-a63b-753e4a07bd19 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.150741 Aug 07 11:00:07.161074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 360/717] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:07 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:07.537199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:07.537720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:07.544153 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:07.544632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:07.545065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:07.545746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:07.546256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:07.546679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:07.669014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lazy-loading 'services' on Instance uuid cad22310-bbff-4a4d-b3e1-08f2f0ee19bb {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:00:07.779348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9e24cabd-790d-42c6-8c1f-a6cc164f13cc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-volume_attachments/a20de1d0-1f10-4555-bc9c-04c59a50cfb0" status: 202 len: 0 microversion: 2.1 time: 0.344433 Aug 07 11:00:07.779972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 358/718] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:00:07 2022] DELETE /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-volume_attachments/a20de1d0-1f10-4555-bc9c-04c59a50cfb0 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:00:08.181125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:08.181724 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:08.188880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:08.189361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:08.189799 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:08.190467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:08.190916 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:08.191357 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:08.320224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:08.329095 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-28872b03-c0d2-4b78-a699-7839379aa3ee tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.151798 Aug 07 11:00:08.329653 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 361/719] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:08 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:09.350684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:09.351405 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:09.358824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:09.359328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:09.359762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:09.360449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:09.360903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:09.361324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:09.494219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:09.503141 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2c3344ce-5fa1-4c0d-a9ed-d12d6d194068 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.157177 Aug 07 11:00:09.503708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 359/720] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:09 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:09.957288 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-58558b06-e7d5-4de9-9e8f-9e7df60a1e57 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:09.963813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-58558b06-e7d5-4de9-9e8f-9e7df60a1e57 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:09.964371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-58558b06-e7d5-4de9-9e8f-9e7df60a1e57 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:09.964802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-58558b06-e7d5-4de9-9e8f-9e7df60a1e57 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:09.988410 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-58558b06-e7d5-4de9-9e8f-9e7df60a1e57 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Going to try to stop instance {{(pid=117615) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 11:00:10.029260 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-58558b06-e7d5-4de9-9e8f-9e7df60a1e57 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action" status: 202 len: 0 microversion: 2.1 time: 0.075784 Aug 07 11:00:10.029854 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 362/721] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 11:00:09 2022] POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 11:00:10.037759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:10.038360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:10.046443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:10.047012 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:10.047385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:10.048072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:10.048523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:10.048955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:10.179563 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:10.189353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ea4ea3df-3dd8-4ee0-95ea-1b8b76f27afb tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.155167 Aug 07 11:00:10.189986 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 360/722] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:10 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:10.524544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:10.525252 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:10.532146 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:10.532636 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:10.533081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:10.533777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:10.534237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:10.534662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:10.667598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:10.675480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ffcd6f43-ae07-440d-8d45-0ccaac21e13b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.155167 Aug 07 11:00:10.676046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 363/723] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:10 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:11.211100 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:11.211640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:11.218007 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:11.218483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:11.218913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:11.219619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:11.220069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:11.220486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:11.347104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:11.355055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-897ffac1-732f-43d9-ace8-bd241c8fc3bf tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.147251 Aug 07 11:00:11.355631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 361/724] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:11 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:11.696773 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:11.697316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:11.703948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:11.704431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:11.704871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:11.705560 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:11.706016 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:11.706437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:11.824841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:11.825331 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:11.831196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:11.831674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:11.832100 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:11.832785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:11.833229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:11.833641 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:11.844263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:11.852283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-563772a0-a811-406c-8cd5-f4b7f24c7c68 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.159450 Aug 07 11:00:11.852850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 364/725] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:11 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:11.916260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lazy-loading 'services' on Instance uuid 3c11e5ef-6384-4377-8b51-992b11842e5f {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:00:11.988806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5cbdf2e8-bab4-47f7-a08a-99eef1a2bd58 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f/os-volume_attachments/04ef49f2-a370-485e-8f98-510a14f975fe" status: 202 len: 0 microversion: 2.1 time: 0.167714 Aug 07 11:00:11.989376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 362/726] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:00:11 2022] DELETE /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f/os-volume_attachments/04ef49f2-a370-485e-8f98-510a14f975fe => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 11:00:12.376101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:12.376712 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:12.382703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:12.383358 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:12.383666 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:12.384371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:12.384825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:12.385249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:12.511530 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:12.518931 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b90f1637-db84-4d7f-bd29-f22d1a5fdb22 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.146604 Aug 07 11:00:12.519512 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 365/727] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:12 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:12.875122 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:12.875816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:12.881800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:12.882274 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:12.882698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:12.883407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:12.883854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:12.884272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:13.016751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:13.024756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3a07dcf3-a224-479a-a5b2-a28c0b6a4227 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.154922 Aug 07 11:00:13.025321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 363/728] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:12 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:13.539683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:13.540292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:13.546873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:13.547388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:13.547841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:13.548509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:13.549001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:13.549424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:13.683508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:13.690786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-05628e08-5521-4d16-9a63-c012a4994128 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.154934 Aug 07 11:00:13.691374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 366/729] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:13 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:14.046006 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:14.046615 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:14.049033 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=50 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:14.054302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.054796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.055262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.055955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.056414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.056842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.075670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:14.167070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:14.167572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:14.173606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.174169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.174697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.175529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.176060 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.176557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.188151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:14.196353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4afb7d2b-4754-4816-bbc1-7bf0ecc7502c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.154228 Aug 07 11:00:14.196929 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 364/730] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:14 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:14.203746 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:00:14.286730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30d7567a-0a41-4dcb-8e4f-caeac0e801ce tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 204 len: 0 microversion: 2.1 time: 0.123293 Aug 07 11:00:14.287352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 367/731] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:00:14 2022] DELETE /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 11:00:14.295936 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:14.296681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:14.302537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.303045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.303478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.304165 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.304662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.305085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.435386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:14.442793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2c7d8733-b915-4744-8199-25e4fe0611e2 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1514 microversion: 2.1 time: 0.151129 Aug 07 11:00:14.443386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 365/732] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:14 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:14.712210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:14.712834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:14.715719 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:14.721405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.721974 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.722412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.723135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:14.723596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:14.724024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:14.851798 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:14.860699 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-92af6ba5-5afc-4786-a530-4c87ee54f97e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.152789 Aug 07 11:00:14.861250 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 368/733] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:14 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:15.218589 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:15.219207 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:15.225599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:15.226070 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:15.226498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:15.227203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:15.227645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:15.228061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:15.355108 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:15.363250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7441f767-375b-409d-8e92-0fefc2b14364 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.149100 Aug 07 11:00:15.363825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 366/734] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:15 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:15.463844 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:15.464546 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:15.470451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:15.470865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:15.471332 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:15.472007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:15.472455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:15.472869 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:15.603940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:15.611882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1c57f641-bdc0-4d16-87dd-4a6c6d994f3b tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1514 microversion: 2.1 time: 0.151868 Aug 07 11:00:15.612444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 369/735] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:15 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:15.881614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:15.882222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:15.888291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:15.888778 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:15.889214 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:15.889907 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:15.890362 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:15.890787 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:16.019313 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:16.026912 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2fd58041-43ad-4a23-ba98-8a45c440309b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.149052 Aug 07 11:00:16.027523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 367/736] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:15 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:16.384413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:16.385032 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:16.391651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:16.392138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:16.392572 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:16.393262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:16.393719 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:16.394162 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:16.412645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:16.525535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:16.534039 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8c3bb31c-07cb-4431-9072-7acf8dfcc6c8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.153495 Aug 07 11:00:16.534612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 370/737] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:16 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:16.633388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:16.634001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:16.643910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:16.644328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:16.644758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:16.645444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:16.645896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:16.646317 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:16.773893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:16.782053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8fd52ebc-f3eb-446e-b370-1b1347c8a0c8 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1514 microversion: 2.1 time: 0.152387 Aug 07 11:00:16.782645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 368/738] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:16 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:17.048547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:17.049195 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:17.055138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.055624 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.056066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.056759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.057223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.058556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.200890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:17.209225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d5eb31b5-df2a-4e56-b9ac-8681eafac89f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.164446 Aug 07 11:00:17.210053 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 371/739] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:17 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:17.268363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-04332dd4-5b93-421a-80a4-c1053aa62edb req-ea4c8d64-53e4-4b0c-b32f-0f4b35eab671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c11e5ef-6384-4377-8b51-992b11842e5f", "name": "network-vif-deleted", "tag": "32fb0d5c-9cd2-40e0-8860-d31268592bae"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:17.279476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-04332dd4-5b93-421a-80a4-c1053aa62edb req-ea4c8d64-53e4-4b0c-b32f-0f4b35eab671 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.280072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-04332dd4-5b93-421a-80a4-c1053aa62edb req-ea4c8d64-53e4-4b0c-b32f-0f4b35eab671 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.280507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-04332dd4-5b93-421a-80a4-c1053aa62edb req-ea4c8d64-53e4-4b0c-b32f-0f4b35eab671 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.291390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-04332dd4-5b93-421a-80a4-c1053aa62edb req-ea4c8d64-53e4-4b0c-b32f-0f4b35eab671 service nova] Creating event network-vif-deleted:32fb0d5c-9cd2-40e0-8860-d31268592bae for instance 3c11e5ef-6384-4377-8b51-992b11842e5f on hv-cinder-85032 Aug 07 11:00:17.296183 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-04332dd4-5b93-421a-80a4-c1053aa62edb req-ea4c8d64-53e4-4b0c-b32f-0f4b35eab671 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031573 Aug 07 11:00:17.296820 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 369/740] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:17.555236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:17.555871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:17.563035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.563535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.563950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.564632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.565086 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.565504 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.694633 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:17.703675 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8a558f45-fd4e-4fbe-a2cc-4b00e493c04a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.152298 Aug 07 11:00:17.704244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 372/741] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:17 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:17.803946 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:17.804752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:17.812199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.812714 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.813130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.813808 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.814270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.814756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.846764 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:17.847288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:17.847720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:17.848165 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lazy-loading 'fault' on Instance uuid 3c11e5ef-6384-4377-8b51-992b11842e5f {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:00:17.890063 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:17.897571 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f9f47e45-7cd8-4aac-9fd2-a1f9d9a059b7 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1308 microversion: 2.1 time: 0.098633 Aug 07 11:00:17.898139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 370/742] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:17 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:18.230786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:18.231418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:18.237603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:18.238083 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:18.238516 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:18.239223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:18.239683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:18.240104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:18.371890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:18.379376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26d27d5e-06c0-46fb-8ffa-b5216c1d89a7 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.152903 Aug 07 11:00:18.379941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 373/743] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:18 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:18.724414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:18.725014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:18.730973 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:18.731451 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:18.731877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:18.732553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:18.733258 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:18.733673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:18.860882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:18.868861 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f533204-85ae-462b-b92b-2c153df248f7 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.148234 Aug 07 11:00:18.869428 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 371/744] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:18 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:18.918957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:18.919514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:18.925841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:18.926320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:18.926753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:18.927466 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:18.927919 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:18.928338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:18.959781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:18.960261 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:18.960692 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:18.961135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lazy-loading 'fault' on Instance uuid 3c11e5ef-6384-4377-8b51-992b11842e5f {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:00:19.001767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4597d928ad24b6c81420f7158e5e98b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ab48958e894bdbb5cd46049356a8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:19.009102 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-080dd58c-3dd8-433d-894c-d63ace84eadc tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 200 len: 1308 microversion: 2.1 time: 0.094833 Aug 07 11:00:19.009663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 374/745] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:18 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:19.399349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:19.399991 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:19.406455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:19.406948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:19.407413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:19.408096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:19.408549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:19.408970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:19.542894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:19.550354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-54ba48d5-92a6-4eb4-a6a7-61fa11c9cf19 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.154769 Aug 07 11:00:19.551013 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 372/746] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:19 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:19.891878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:19.892419 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:19.898236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:19.898740 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:19.899184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:19.899865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:19.900315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:19.900733 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:20.029225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:20.029968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:20.030580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] [instance: 3c11e5ef-6384-4377-8b51-992b11842e5f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:20.037261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:20.037419 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-70e3eabe-f41a-4f5e-ac21-dc0b33c4789c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.149427 Aug 07 11:00:20.037742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:20.037939 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 375/747] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:19 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:20.038174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:20.038864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:20.039341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:20.039762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:20.054171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] HTTP exception thrown: Instance 3c11e5ef-6384-4377-8b51-992b11842e5f could not be found. Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Request method failure captured: Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f HTTP/1.1 Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75qk5ZOKG3xyn6fkr1jXeyINPmT_YuhKfQIa0h9tf7whUf8vtwS8u4JZAObWth81WwJGPuRN5ehu042fnYxnVt-FlCBsBuoqi-R2OQNBVe5NWysu7waXaFK0MS4YUJaXxEd7sMjGXHqFpsojTMm6vyqS1bjZBpXrqnIgv-05X3_gWrg Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 81ab48958e894bdbb5cd46049356a8a0 Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1183292982 Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:00:20.055882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/81ab48958e894bdbb5cd46049356a8a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_81ab48958e894bdbb5cd46049356a8a0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81ab48958e894bdbb5cd46049356a8a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/81ab48958e894bdbb5cd46049356a8a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesSnapshotTestJSON-1183292982 Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 81ab48958e894bdbb5cd46049356a8a0 Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1183292982 Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesSnapshotTestJSON-1183292982-project Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: c4597d928ad24b6c81420f7158e5e98b Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesSnapshotTestJSON-1183292982-project Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 3c11e5ef-6384-4377-8b51-992b11842e5f could not be found. Aug 07 11:00:20.057572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '3c11e5ef-6384-4377-8b51-992b11842e5f'} Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c11e5ef-6384-4377-8b51-992b11842e5f could not be found. Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:00:20.058383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c11e5ef-6384-4377-8b51-992b11842e5f could not be found. Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c11e5ef-6384-4377-8b51-992b11842e5f could not be found. Aug 07 11:00:20.059627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:00:20.060866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] Returning 404 to user: Instance 3c11e5ef-6384-4377-8b51-992b11842e5f could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:00:20.060866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e5763395-b31f-413d-95f8-5f9cb7a5b831 tempest-VolumesSnapshotTestJSON-1183292982 tempest-VolumesSnapshotTestJSON-1183292982-project] 10.222.0.25 "GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f" status: 404 len: 111 microversion: 2.1 time: 0.031590 Aug 07 11:00:20.060866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 373/748] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:20 2022] GET /compute/v2.1/servers/3c11e5ef-6384-4377-8b51-992b11842e5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 11:00:20.572489 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:20.573788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:20.579792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:20.580283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:20.580724 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:20.581417 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:20.581879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:20.582303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:20.716028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:20.723455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e03bfab3-a1df-4b80-96b8-758369e5c52c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1678 microversion: 2.1 time: 0.154845 Aug 07 11:00:20.724013 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 376/749] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:20 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:00:21.059448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:21.060061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:21.066493 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:21.067006 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:21.067443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:21.068130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:21.068588 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:21.069014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:21.210590 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:21.218676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fe965100-52d8-470f-8e08-6cdc22e44619 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1737 microversion: 2.1 time: 0.163747 Aug 07 11:00:21.219295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 374/750] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:21 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:21.744577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:21.745354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:21.751717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:21.752194 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:21.752623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:21.753311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:21.753813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:21.754180 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:21.884522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:21.892730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2953f998-ab41-46c0-8b44-400129ca4135 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1655 microversion: 2.1 time: 0.152025 Aug 07 11:00:21.893295 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 377/751] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:21 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:21.913434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a48a553-123e-45dd-a9b2-94e74cbaa22f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:21.919478 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a48a553-123e-45dd-a9b2-94e74cbaa22f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:21.919960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a48a553-123e-45dd-a9b2-94e74cbaa22f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:21.920395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a48a553-123e-45dd-a9b2-94e74cbaa22f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:21.943127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2a48a553-123e-45dd-a9b2-94e74cbaa22f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Going to try to start instance {{(pid=117616) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 11:00:21.986883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2a48a553-123e-45dd-a9b2-94e74cbaa22f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action" status: 202 len: 0 microversion: 2.1 time: 0.077155 Aug 07 11:00:21.987533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 375/752] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 11:00:21 2022] POST /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:00:21.995612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:21.996307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:22.002316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.002710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.003189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.003965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.004334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.004813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.241673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:22.242371 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:22.248903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.249379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.249808 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.250500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.250968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.251387 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.410671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:22.421986 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-763c4096-8bbb-4af5-b88c-e6dbbb7721a5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1664 microversion: 2.1 time: 0.430119 Aug 07 11:00:22.422576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 378/753] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:21 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1664 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:22.433522 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:22.441324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ca2ffafe-484c-4c6a-9421-deed380dfbfb tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1717 microversion: 2.1 time: 0.204457 Aug 07 11:00:22.441877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 376/754] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:22 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1717 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:00:22.501955 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:22.502440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:22.508275 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.508750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.509179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.509850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.510821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.511276 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.592331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] HTTP exception thrown: Cannot 'detach_volume' instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f while it is in vm_state rescued Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Request method failure captured: Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments/e40f40c2-0cde-422c-a16b-b203192c1230 HTTP/1.1 Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nVmZDqBLrDKaFPcpgAj1m59o29KiJgkU6QeMiRKYvuG9-HKcbDZxNkXe76Ofs3N4KQZo7-rYjxd-AAuB1e9uveaUp_uErWexkSZnBV-MiPM-RB2A0a0n43oyr-LtZIoAqjTuEE7K1-qP7s_rvHIN5ja6d9GrzIlpu9G6EPnUpBEd4 Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:00:22.593930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6ca365836428198f2d20fd9829feb", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c3a12c3144844d32812e010550bb0921 Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:00:22.595529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Cannot 'detach_volume' instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f while it is in vm_state rescued Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'server_id': 'edf03e0d-d4df-471c-a17e-db0ab8dbbc1f', 'id': 'e40f40c2-0cde-422c-a16b-b203192c1230'} Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:00:22.596341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f while it is in vm_state rescued Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f while it is in vm_state rescued Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:00:22.597605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Returning 409 to user: Cannot 'detach_volume' instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f while it is in vm_state rescued {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:00:22.598575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-96c95701-bc8b-4b5f-8d1c-e0a3d8e857a1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments/e40f40c2-0cde-422c-a16b-b203192c1230" status: 409 len: 152 microversion: 2.1 time: 0.097277 Aug 07 11:00:22.598575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 379/755] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:00:22 2022] DELETE /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments/e40f40c2-0cde-422c-a16b-b203192c1230 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 11:00:22.604407 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:22.605126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:22.611190 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.611666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.612095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.612772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.613217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.613635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.676334 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0f1ce7c8-a64d-4aca-b78d-27987e53b528 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "POST /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/action" status: 202 len: 0 microversion: 2.1 time: 0.075737 Aug 07 11:00:22.679940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 377/756] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 11:00:22 2022] POST /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 11:00:22.685292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:22.685904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:22.691818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.692301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.692735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.693422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:22.693879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:22.694300 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:22.826142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:22.834074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d14a50e9-644f-4c6c-a55e-a7c42db8847f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1725 microversion: 2.1 time: 0.152866 Aug 07 11:00:22.834635 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 380/757] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:22 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:23.443576 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:23.444270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:23.451005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:23.451485 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:23.451918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:23.452594 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:23.453049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:23.453467 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:23.583338 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:23.591518 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d027dde6-c1f6-4f45-bb54-f26b8edf984a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1664 microversion: 2.1 time: 0.152454 Aug 07 11:00:23.592072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 378/758] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:23 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:23.856148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:23.856661 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:23.863592 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:23.864317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:23.864873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:23.865852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:23.866327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:23.866736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:23.995905 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:24.003880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-04ddbfaf-2f82-4ea2-9347-8e42db2a2031 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1725 microversion: 2.1 time: 0.152362 Aug 07 11:00:24.004444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 381/759] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:23 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:24.611923 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:24.612534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:24.618910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:24.619417 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:24.620672 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:24.621377 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:24.621829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:24.622252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:24.754600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:24.762786 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-21c3d398-09ed-46bf-b532-87aa60ad8b98 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1664 microversion: 2.1 time: 0.154867 Aug 07 11:00:24.763374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 379/760] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:24 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:25.025480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:25.026786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:25.034425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:25.034913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:25.035399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:25.036097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:25.036557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:25.036979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:25.182458 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:25.191387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ef343b22-4e2c-410b-a30f-b13fa36dd0c3 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1725 microversion: 2.1 time: 0.169551 Aug 07 11:00:25.192424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 382/761] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:25 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:25.783865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:25.784479 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:25.792114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:25.792606 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:25.793057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:25.794138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:25.794721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:25.795376 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:25.800189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:26.061558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:26.076057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-27510386-8b15-4c1a-a87c-8aa16c94238a tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1664 microversion: 2.1 time: 0.295959 Aug 07 11:00:26.094760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 380/762] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:25 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1664 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:00:26.212928 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:26.214284 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:26.221396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:26.222008 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:26.222739 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:26.224360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:26.224928 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:26.225700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:26.383468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:26.393848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-16ef2f81-dbc5-450a-a1b6-8dd5a045ba0c tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1725 microversion: 2.1 time: 0.184613 Aug 07 11:00:26.394450 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 383/763] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:26 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:27.099982 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:27.100757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:27.107366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:27.107852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:27.108553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:27.109260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:27.109716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:27.110137 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:27.243755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:27.251294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4a43ad98-620a-47a6-94ce-6ce2a2c49c5c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1668 microversion: 2.1 time: 0.155149 Aug 07 11:00:27.251858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 381/764] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:27 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:27.415849 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:27.416555 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:27.423301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:27.423721 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:27.424149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:27.424836 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:27.425290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:27.425707 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:27.553523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:27.562175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-428e969f-0e1c-474d-9dd4-d40162d86c60 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1725 microversion: 2.1 time: 0.150187 Aug 07 11:00:27.562735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 384/765] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:27 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:28.584135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:28.584799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:28.592240 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:28.592768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:28.593209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:28.593899 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:28.594357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:28.594779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:28.739260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:28.747844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bc8b927d-7f19-4109-8490-bf55af34edfe tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1725 microversion: 2.1 time: 0.167828 Aug 07 11:00:28.748444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 382/766] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:28 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:29.769887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:29.770407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:29.777567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:29.778271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:29.778901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:29.779612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:29.780069 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:29.780487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:29.917690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:29.925836 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bd1660bf-f896-41ad-87df-ab88df25e1e1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1725 microversion: 2.1 time: 0.159947 Aug 07 11:00:29.926409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 385/767] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:29 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:30.947581 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:30.948260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:30.954761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:30.955210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:30.955673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:30.956352 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:30.956805 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:30.957224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:31.087777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:31.096504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7af02ecd-70c0-4487-925b-ae98dddc916e tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1731 microversion: 2.1 time: 0.152843 Aug 07 11:00:31.097075 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 383/768] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:30 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:31.119096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:31.119622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:31.126132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:31.126608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:31.127265 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:31.128122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:31.128576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:31.128992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:31.209550 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8c10021a-ce06-4609-a13b-3bde425ffbe1 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094315 Aug 07 11:00:31.210144 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 386/769] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 11:00:31 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:32.078436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-675cd700-a261-4ec0-bf9d-c5b3a6188461 req-230390a2-b9ab-485f-8c9c-b033d8f5cf30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf03e0d-d4df-471c-a17e-db0ab8dbbc1f", "tag": "8f5e1d77-61de-4709-a023-e0d9df750ea5"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:32.089484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-675cd700-a261-4ec0-bf9d-c5b3a6188461 req-230390a2-b9ab-485f-8c9c-b033d8f5cf30 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:32.090206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-675cd700-a261-4ec0-bf9d-c5b3a6188461 req-230390a2-b9ab-485f-8c9c-b033d8f5cf30 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:32.090794 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-675cd700-a261-4ec0-bf9d-c5b3a6188461 req-230390a2-b9ab-485f-8c9c-b033d8f5cf30 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:32.102561 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-675cd700-a261-4ec0-bf9d-c5b3a6188461 req-230390a2-b9ab-485f-8c9c-b033d8f5cf30 service nova] Creating event network-changed:8f5e1d77-61de-4709-a023-e0d9df750ea5 for instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f on hv-cinder-85032 Aug 07 11:00:32.108945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-675cd700-a261-4ec0-bf9d-c5b3a6188461 req-230390a2-b9ab-485f-8c9c-b033d8f5cf30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034074 Aug 07 11:00:32.109543 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 384/770] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:34.123940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-0b0265f1-4aa8-48da-b60e-54ce5f62e678 req-fa1475e5-1b6e-41bf-80eb-7a59c381e417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf03e0d-d4df-471c-a17e-db0ab8dbbc1f", "tag": "8f5e1d77-61de-4709-a023-e0d9df750ea5"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:34.133117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0b0265f1-4aa8-48da-b60e-54ce5f62e678 req-fa1475e5-1b6e-41bf-80eb-7a59c381e417 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:34.133583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0b0265f1-4aa8-48da-b60e-54ce5f62e678 req-fa1475e5-1b6e-41bf-80eb-7a59c381e417 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:34.134004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0b0265f1-4aa8-48da-b60e-54ce5f62e678 req-fa1475e5-1b6e-41bf-80eb-7a59c381e417 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:34.138472 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=100 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:34.146185 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-0b0265f1-4aa8-48da-b60e-54ce5f62e678 req-fa1475e5-1b6e-41bf-80eb-7a59c381e417 service nova] Creating event network-changed:8f5e1d77-61de-4709-a023-e0d9df750ea5 for instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f on hv-cinder-85032 Aug 07 11:00:34.151697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-0b0265f1-4aa8-48da-b60e-54ce5f62e678 req-fa1475e5-1b6e-41bf-80eb-7a59c381e417 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032471 Aug 07 11:00:34.152325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 387/771] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:41.175315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:41.175944 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:41.183489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:41.183970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:41.184412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:41.185127 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:41.185588 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:41.186012 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:41.207847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lazy-loading 'flavor' on Instance uuid 223548c0-1e24-46fc-8238-56a431aadfd0 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:00:41.280288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4ca6be15-0073-4511-8020-7c332e4bab41 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "POST /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0/action" status: 202 len: 0 microversion: 2.1 time: 0.109211 Aug 07 11:00:41.280874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 385/772] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 11:00:41 2022] POST /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 11:00:41.290153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:41.290859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:41.297392 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:41.297946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:41.298412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:41.299245 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:41.299709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:41.300133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:41.436089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:41.443517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2c293ac2-101f-455f-94f6-a86e6e8bb006 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.158196 Aug 07 11:00:41.444073 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 388/773] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:41 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:42.522611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:42.523340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:42.530101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:42.530582 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:42.531049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:42.531737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:42.532193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:42.532617 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:42.664540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:42.673062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-da83850e-8112-450a-a692-27ea46994bd3 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.155028 Aug 07 11:00:42.673561 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 386/774] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:42 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:43.694334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:43.694911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:43.701286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:43.701762 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:43.702189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:43.702868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:43.703353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:43.703771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:43.832988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:43.840955 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26374a5f-92dd-4499-b78c-dae070702910 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.150545 Aug 07 11:00:43.841527 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 389/775] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:43 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:44.862877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:44.863515 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:44.865888 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=48 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:44.871623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:44.872099 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:44.872523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:44.873202 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:44.873651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:44.874094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:45.007035 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:45.014473 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-862ac939-2a2f-40d3-94c6-4e08558954d9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.155620 Aug 07 11:00:45.015059 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 387/776] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:44 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:46.035610 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:46.036225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:46.038726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=46 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:46.045208 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:46.045695 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:46.046134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:46.046825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:46.047363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:46.047820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:46.189092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:46.197226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e48a699-1a3d-442a-8cf1-16bc557389e1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.165346 Aug 07 11:00:46.197921 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 390/777] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:46 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:47.218113 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:47.218763 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:47.225766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:47.225766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:47.225766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:47.226174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:47.226623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:47.227062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:47.366752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:47.375823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-114371e3-447c-41d6-8d1a-f88183d93883 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.161858 Aug 07 11:00:47.376405 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 388/778] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:47 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:00:48.397238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:48.397937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:48.404714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:48.405196 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:48.405631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:48.406319 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:48.406775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:48.407231 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:48.540052 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:48.547756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2c30ebfd-3e99-41d9-9c22-5411a424a2b6 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.154450 Aug 07 11:00:48.548323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 391/779] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:48 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:49.569136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:49.569771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:49.576682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:49.577154 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:49.577578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:49.578252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:49.578702 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:49.579148 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:49.709399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:49.717492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b84b2561-9634-4dea-8dca-6304c04f320b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.152141 Aug 07 11:00:49.718060 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 389/780] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:49 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:50.737819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:50.738380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:50.744865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:50.745338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:50.745765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:50.746457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:50.746903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:50.747342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:50.878391 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:50.885877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-df562914-eaf2-465c-a405-090848ff1049 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.151980 Aug 07 11:00:50.886471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 392/781] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:50 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:51.906350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:51.906877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:51.914068 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:51.914545 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:51.915001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:51.916206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:51.916660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:51.917072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:52.050907 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:52.058990 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c00e9293-d29a-4abd-a58c-1726c1825973 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.156550 Aug 07 11:00:52.059548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 390/782] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:51 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:53.080221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:53.080825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:53.087360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:53.087839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:53.088298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:53.088987 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:53.089437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:53.089871 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:53.216458 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:53.223950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f25c1f22-2049-4790-a6ee-fd0b25713429 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.147589 Aug 07 11:00:53.224511 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 393/783] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:53 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:54.245840 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:54.246447 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:54.252844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:54.253351 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:54.253787 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:54.254468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:54.254947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:54.255367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:54.391084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:54.398667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e681c986-1540-45ab-b0ce-22fe382a0eb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.156718 Aug 07 11:00:54.399266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 391/784] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:54 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:55.420739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:55.421558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:55.428186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:55.428669 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:55.429105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:55.429765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:55.430212 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:55.430633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:55.562095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:55.571296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2a458acf-1023-4902-883b-8f91ea9a3659 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.155395 Aug 07 11:00:55.579170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 392/785] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:55 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:55.584857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-166872206"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:55.585411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:55.591329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:55.591814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:55.592240 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:55.592926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:55.593374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:55.593784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:55.722051 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.network.security_group_api [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Removing security group e4a409ce-9bed-4029-838e-8b0c612ef18f from port 3cd59e35-98cf-47ca-bef7-d9000d1de278 Aug 07 11:00:56.032961 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9c3854f7-8cb9-442b-921b-b28174dacabf tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/action" status: 202 len: 0 microversion: 2.1 time: 0.624443 Aug 07 11:00:56.033579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 394/786] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 11:00:55 2022] POST /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:00:56.042915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-3961080e-4c88-40e4-a735-c58d51a1b7af req-c3207a6b-f552-4af6-8184-99791edc1eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423c8be-dde1-4173-8d7b-cf9be55ee8ca", "tag": "3cd59e35-98cf-47ca-bef7-d9000d1de278"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:56.052316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3961080e-4c88-40e4-a735-c58d51a1b7af req-c3207a6b-f552-4af6-8184-99791edc1eb3 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:56.052797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3961080e-4c88-40e4-a735-c58d51a1b7af req-c3207a6b-f552-4af6-8184-99791edc1eb3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:56.054038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3961080e-4c88-40e4-a735-c58d51a1b7af req-c3207a6b-f552-4af6-8184-99791edc1eb3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:56.056101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:56.068516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-3961080e-4c88-40e4-a735-c58d51a1b7af req-c3207a6b-f552-4af6-8184-99791edc1eb3 service nova] Creating event network-changed:3cd59e35-98cf-47ca-bef7-d9000d1de278 for instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca on hv-cinder-85032 Aug 07 11:00:56.074355 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-3961080e-4c88-40e4-a735-c58d51a1b7af req-c3207a6b-f552-4af6-8184-99791edc1eb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035888 Aug 07 11:00:56.075438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 393/787] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:56.594841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:56.595487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:56.601645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:56.602153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:56.602587 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:56.603477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:56.604497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:56.604971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:57.027550 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:57.035027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35809435-c38c-4fa2-ba3d-8c259b63b50b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.444671 Aug 07 11:00:57.035598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 395/788] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:56 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:57.366299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:57.366879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:57.374390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:57.374877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:57.375336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:57.376032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:57.376491 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:57.376919 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:57.460118 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lazy-loading 'services' on Instance uuid b423c8be-dde1-4173-8d7b-cf9be55ee8ca {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:00:57.531299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-10c4224f-51c2-44fc-9bb1-dcb93ed59096 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments/d6183409-7891-4060-aea6-835931632b0e" status: 202 len: 0 microversion: 2.1 time: 0.169011 Aug 07 11:00:57.532004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 394/789] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:00:57 2022] DELETE /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments/d6183409-7891-4060-aea6-835931632b0e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:00:57.540357 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:57.542893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:57.548934 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:57.549423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:57.549864 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:57.550558 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:57.551047 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:57.551473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:57.583781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1b55d1da-3ea3-4111-a6bc-bd5b92707958 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Aug 07 11:00:57.584369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 396/790] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:00:57 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:00:58.056683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:58.057877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:58.063995 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:58.064472 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:58.064900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:58.065579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:58.066025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:58.066441 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:58.088955 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-bfa77d1d-bc29-4760-8dee-1aa2248d448c req-312bd198-4051-4c8a-b081-fad738360104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423c8be-dde1-4173-8d7b-cf9be55ee8ca", "tag": "3cd59e35-98cf-47ca-bef7-d9000d1de278"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:00:58.102508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-bfa77d1d-bc29-4760-8dee-1aa2248d448c req-312bd198-4051-4c8a-b081-fad738360104 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:58.103337 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-bfa77d1d-bc29-4760-8dee-1aa2248d448c req-312bd198-4051-4c8a-b081-fad738360104 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:58.103796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-bfa77d1d-bc29-4760-8dee-1aa2248d448c req-312bd198-4051-4c8a-b081-fad738360104 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:58.116996 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-bfa77d1d-bc29-4760-8dee-1aa2248d448c req-312bd198-4051-4c8a-b081-fad738360104 service nova] Creating event network-changed:3cd59e35-98cf-47ca-bef7-d9000d1de278 for instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca on hv-cinder-85032 Aug 07 11:00:58.123372 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-bfa77d1d-bc29-4760-8dee-1aa2248d448c req-312bd198-4051-4c8a-b081-fad738360104 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037735 Aug 07 11:00:58.124061 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 397/791] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:58.214472 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:58.222005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6b0ab544-1a2b-472f-b295-3a9d33de38f9 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.169505 Aug 07 11:00:58.222565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 395/792] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:58 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:58.598191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:58.600472 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:58.607723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:58.608458 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:58.608937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:58.609656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:58.610151 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:58.610603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:58.639610 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a1ad2256-383e-46f7-96ee-fd63d6afcff8 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Aug 07 11:00:58.640158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 398/793] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:00:58 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:00:59.243671 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:59.244209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:59.250815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:59.251337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:59.251773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:59.252470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:59.252929 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:59.253343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:59.401357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:00:59.410337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9180ecac-0a43-4f3c-a09a-ac54c16dbf15 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.170672 Aug 07 11:00:59.410916 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 396/794] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:00:59 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:00:59.651998 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:00:59.654134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:00:59.660564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:59.661046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:59.661489 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:59.662186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:00:59.662642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:00:59.663101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:00:59.691661 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-41a88703-d2c8-4cae-85ea-7d2a1ee37bdc tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043654 Aug 07 11:00:59.692443 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 399/795] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:00:59 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:01:00.431433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:00.432547 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:00.438474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:00.438988 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:00.439424 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:00.440109 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:00.440573 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:00.441000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:00.577449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:00.585190 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-042f4cff-fd0d-484c-8ec0-4f072ab71617 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.157536 Aug 07 11:01:00.585758 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 397/796] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:00 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:00.704452 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:00.706710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:00.713975 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:00.714466 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:00.714898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:00.715619 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:00.716068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:00.716498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:00.745016 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6ba52c41-e132-4dfb-a722-fa0e3a7dfcf9 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044292 Aug 07 11:01:00.745580 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 400/797] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:00 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:01.607865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:01.608729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:01.615128 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:01.615607 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:01.616038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:01.616721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:01.617174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:01.617596 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:01.748155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:01.755646 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d3ce4430-872a-4557-9def-0fd669fe02fd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.152510 Aug 07 11:01:01.756201 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 398/798] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:01 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:01.757364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:01.759609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:01.766006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:01.766492 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:01.766947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:01.767647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:01.768105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:01.768530 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:01.797713 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26d38519-b91c-41c9-8aee-25e9103bcae2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044365 Aug 07 11:01:01.798283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 401/799] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:01 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:01:02.776818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:02.777465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:02.783953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:02.784429 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:02.784858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:02.785538 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:02.785991 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:02.786410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:02.810432 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:02.812618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:02.819025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:02.819516 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:02.819954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:02.820656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:02.821145 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:02.821574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:02.851343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f69cdac0-c82b-4627-aad2-c55c65c9662c tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Aug 07 11:01:02.851921 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 402/800] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:02 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:01:02.920964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:02.928437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a1280e3d-549c-451f-9046-7272b606e70a tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.155670 Aug 07 11:01:02.929000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 399/801] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:02 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:03.864306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:03.866479 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:03.872900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:03.873381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:03.873811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:03.874497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:03.874974 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:03.875394 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:03.903906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-75cce230-e853-4643-88cc-6080235eb8b2 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Aug 07 11:01:03.904462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 403/802] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:03 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:03.950459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:03.951789 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:03.958343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:03.958817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:03.959279 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:03.959966 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:03.960411 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:03.960837 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:04.096096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:04.103618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7ce718dd-7188-4f8e-a0f0-5e83c40ce801 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.157986 Aug 07 11:01:04.104188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 400/803] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:03 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:04.915304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:04.918082 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:04.924408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:04.924890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:04.925351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:04.926042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:04.926493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:04.926937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:04.930557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=91 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:04.955448 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-05e3fb05-223b-42e7-8e8c-6e7ae3ec2606 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Aug 07 11:01:04.956004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 404/804] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:04 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:05.125438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:05.126058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:05.132521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:05.132998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:05.133431 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:05.134114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:05.134568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:05.135546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:05.269832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:05.278081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9c092943-867e-411a-a02c-d7f99e2c558c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.156546 Aug 07 11:01:05.278719 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 401/805] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:05 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:05.967951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:05.970700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:05.977138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:05.977604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:05.978037 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:05.979323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:05.979954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:05.980545 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:06.011427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-19c6e620-e8ee-44cd-9586-b135e275af7d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047335 Aug 07 11:01:06.017136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 405/806] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:05 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 11:01:06.022651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:06.023170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:06.029803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:06.030759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:06.031215 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:06.031950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:06.033288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:06.034352 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:06.113698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] HTTP exception thrown: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca is not attached to volume d6183409-7891-4060-aea6-835931632b0e Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Request method failure captured: Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments/d6183409-7891-4060-aea6-835931632b0e HTTP/1.1 Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75oNM_9bBZWp797EeR7Z7HYKrQS_-HJ55QATe2otVW5Q8qfMUVjnnZWaPUkotXcjoTO6kGMjuoEQmXe9CIKhAjRa95TH3VhKSxMGxNWq99xJed52OnbnOhu3Q5qK3XujRehHMDbULrAZueFJS_k1dmwi6Cqp-JoTXAEkkA6yGVQ1YAo Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 112b9a6f7ead454695e7efd26c0d845b Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestMinimumBasicScenario-206902706 Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:01:06.116103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/112b9a6f7ead454695e7efd26c0d845b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_112b9a6f7ead454695e7efd26c0d845b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/112b9a6f7ead454695e7efd26c0d845b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/112b9a6f7ead454695e7efd26c0d845b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestMinimumBasicScenario-206902706 Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 112b9a6f7ead454695e7efd26c0d845b Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestMinimumBasicScenario-206902706 Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-TestMinimumBasicScenario-206902706-project Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: ee9ca3b9c7284fd1a600cbd3add41f56 Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestMinimumBasicScenario-206902706-project Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:01:06.117769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca is not attached to volume d6183409-7891-4060-aea6-835931632b0e Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'server_id': 'b423c8be-dde1-4173-8d7b-cf9be55ee8ca', 'id': 'd6183409-7891-4060-aea6-835931632b0e'} Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d6183409-7891-4060-aea6-835931632b0e. Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:01:06.118675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca is not attached to volume d6183409-7891-4060-aea6-835931632b0e Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca is not attached to volume d6183409-7891-4060-aea6-835931632b0e Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:06.120766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Returning 404 to user: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca is not attached to volume d6183409-7891-4060-aea6-835931632b0e {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:01:06.121930 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1c663cfb-09bb-40e5-bb14-655385b6ef99 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments/d6183409-7891-4060-aea6-835931632b0e" status: 404 len: 154 microversion: 2.1 time: 0.098758 Aug 07 11:01:06.121930 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 402/807] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:01:06 2022] DELETE /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca/os-volume_attachments/d6183409-7891-4060-aea6-835931632b0e => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:01:06.299981 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:06.300608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:06.306643 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:06.307413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:06.307583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:06.308375 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:06.308908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:06.309423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:06.456800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:06.466012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-11ba8c48-4691-4c31-9816-a3d0bf0ade0b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.169896 Aug 07 11:01:06.466675 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 406/808] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:06 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:07.260941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:07.261465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:07.267768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.268250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.268679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.269392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.269847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.270265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.297969 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:01:07.377945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d6e80691-a484-4a78-9978-8fd946445ba5 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 204 len: 0 microversion: 2.1 time: 0.120474 Aug 07 11:01:07.378747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 403/809] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:01:07 2022] DELETE /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:01:07.388478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:07.389125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:07.399590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.400086 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.400732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.401441 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.401905 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.402334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.488876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:07.489582 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:07.496686 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.497171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.497613 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.498312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.498767 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.499222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.537730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:07.546081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-683b3f11-1d0a-4813-89f7-8f6e3e861c5b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1553 microversion: 2.1 time: 0.162968 Aug 07 11:01:07.546666 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 407/810] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:07 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:07.635904 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:07.643602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-09494579-e007-4aa8-8b84-8da060247b10 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1511 microversion: 2.1 time: 0.158907 Aug 07 11:01:07.644166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 404/811] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:07 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:01:07.663745 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:07.664341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:07.670829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.671340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.671766 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.672447 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.672912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.673311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.709025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117615) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 11:01:07.925824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e5ff9bb-4488-47f2-a1f4-079e91b755cd tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "POST /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0/action" status: 202 len: 0 microversion: 2.1 time: 0.265771 Aug 07 11:01:07.926350 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 408/812] 10.222.0.25 () {60 vars in 1278 bytes} [Sun Aug 7 11:01:07 2022] POST /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:01:07.935723 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:07.936334 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:07.942180 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.942663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.943146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:07.943813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:07.944270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:07.944695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:08.088073 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:08.096005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bab771f6-24a5-444a-8377-7a266a59168f tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1519 microversion: 2.1 time: 0.165350 Aug 07 11:01:08.096643 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 405/813] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:07 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:08.569120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:08.569792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:08.576731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:08.577329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:08.577824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:08.578573 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:08.579130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:08.579677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:08.712599 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:08.721072 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6fd2caf3-ea57-42cb-8fc5-3d7ba96bcb6d tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1553 microversion: 2.1 time: 0.156604 Aug 07 11:01:08.721700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 409/814] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:08 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:09.117761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:09.118386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:09.126215 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:09.126792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:09.127255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:09.127961 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:09.128421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:09.128841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:09.196331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-d9a37d4c-51a0-4ef5-96ad-6592449ab401 req-e4b0e5c0-f219-4112-ac13-c28f1ea93185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223548c0-1e24-46fc-8238-56a431aadfd0", "name": "network-vif-unplugged", "status": "completed", "tag": "2d0a513b-66b5-4ab9-9279-4055a67679fb"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:09.218228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d9a37d4c-51a0-4ef5-96ad-6592449ab401 req-e4b0e5c0-f219-4112-ac13-c28f1ea93185 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:09.226342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d9a37d4c-51a0-4ef5-96ad-6592449ab401 req-e4b0e5c0-f219-4112-ac13-c28f1ea93185 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:09.228008 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d9a37d4c-51a0-4ef5-96ad-6592449ab401 req-e4b0e5c0-f219-4112-ac13-c28f1ea93185 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:09.250100 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.compute.server_external_events [req-d9a37d4c-51a0-4ef5-96ad-6592449ab401 req-e4b0e5c0-f219-4112-ac13-c28f1ea93185 service nova] Unable to find a host for instance 223548c0-1e24-46fc-8238-56a431aadfd0. Dropping event network-vif-unplugged {{(pid=117615) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 11:01:09.251590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-d9a37d4c-51a0-4ef5-96ad-6592449ab401 req-e4b0e5c0-f219-4112-ac13-c28f1ea93185 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061076 Aug 07 11:01:09.252437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 410/815] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 07 11:01:09.292138 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:09.299863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-55356415-4c41-4dc2-bebc-7a503333e307 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1519 microversion: 2.1 time: 0.186002 Aug 07 11:01:09.303022 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 406/816] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:09 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:09.743184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:09.743808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:09.750889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:09.751514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:09.751840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:09.752540 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:09.753001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:09.753429 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:09.887172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:09.894502 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1e99de19-03ec-4b14-935a-97e214b0ffc6 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1553 microversion: 2.1 time: 0.156665 Aug 07 11:01:09.895086 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 411/817] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:09 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:01:10.321636 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:10.322900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:10.330061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:10.330553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:10.331438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:10.332328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:10.332945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:10.333544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:10.495777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:10.503965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4a0c1290-b920-4bdf-b524-57559602e29c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1521 microversion: 2.1 time: 0.186544 Aug 07 11:01:10.504855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 407/818] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:10 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:01:10.579438 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-6d3f4609-f557-4270-bdc4-681ec812f4d0 req-2716cda9-2e10-4be3-9042-f55d4160e3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b423c8be-dde1-4173-8d7b-cf9be55ee8ca", "name": "network-vif-deleted", "tag": "3cd59e35-98cf-47ca-bef7-d9000d1de278"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:10.590867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6d3f4609-f557-4270-bdc4-681ec812f4d0 req-2716cda9-2e10-4be3-9042-f55d4160e3fb service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:10.591378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6d3f4609-f557-4270-bdc4-681ec812f4d0 req-2716cda9-2e10-4be3-9042-f55d4160e3fb service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:10.591973 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6d3f4609-f557-4270-bdc4-681ec812f4d0 req-2716cda9-2e10-4be3-9042-f55d4160e3fb service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:10.604673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-6d3f4609-f557-4270-bdc4-681ec812f4d0 req-2716cda9-2e10-4be3-9042-f55d4160e3fb service nova] Creating event network-vif-deleted:3cd59e35-98cf-47ca-bef7-d9000d1de278 for instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca on hv-cinder-85032 Aug 07 11:01:10.610652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-6d3f4609-f557-4270-bdc4-681ec812f4d0 req-2716cda9-2e10-4be3-9042-f55d4160e3fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035296 Aug 07 11:01:10.611618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 412/819] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:01:10.917274 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:10.918192 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:10.924783 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:10.925261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:10.925964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:10.926894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:10.928146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:10.928770 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:10.935160 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:10.967252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:10.967994 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:10.968594 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:10.969053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lazy-loading 'fault' on Instance uuid b423c8be-dde1-4173-8d7b-cf9be55ee8ca {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:01:11.021705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9ca3b9c7284fd1a600cbd3add41f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112b9a6f7ead454695e7efd26c0d845b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:11.029464 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-81319b64-9ea8-4c94-834c-0f43aebff517 tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 200 len: 1348 microversion: 2.1 time: 0.116764 Aug 07 11:01:11.030041 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 408/820] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:10 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 1348 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:11.527949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:11.529318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:11.535784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:11.536278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:11.536714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:11.537421 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:11.537913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:11.538338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:11.673547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:11.681350 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1aaa1e6d-15b3-42a4-9f7f-e713e127827e tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.159914 Aug 07 11:01:11.682467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 413/821] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:11 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:12.051260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:12.051867 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] [instance: b423c8be-dde1-4173-8d7b-cf9be55ee8ca] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:12.059218 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:12.059679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:12.060120 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:12.060806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:12.061499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:12.062200 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:12.077962 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] HTTP exception thrown: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca could not be found. Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Request method failure captured: Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca HTTP/1.1 Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75oNM_9bBZWp797EeR7Z7HYKrQS_-HJ55QATe2otVW5Q8qfMUVjnnZWaPUkotXcjoTO6kGMjuoEQmXe9CIKhAjRa95TH3VhKSxMGxNWq99xJed52OnbnOhu3Q5qK3XujRehHMDbULrAZueFJS_k1dmwi6Cqp-JoTXAEkkA6yGVQ1YAo Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 112b9a6f7ead454695e7efd26c0d845b Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestMinimumBasicScenario-206902706 Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:01:12.079619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/112b9a6f7ead454695e7efd26c0d845b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_112b9a6f7ead454695e7efd26c0d845b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/112b9a6f7ead454695e7efd26c0d845b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/112b9a6f7ead454695e7efd26c0d845b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestMinimumBasicScenario-206902706 Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 112b9a6f7ead454695e7efd26c0d845b Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestMinimumBasicScenario-206902706 Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-TestMinimumBasicScenario-206902706-project Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: ee9ca3b9c7284fd1a600cbd3add41f56 Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestMinimumBasicScenario-206902706-project Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca could not be found. Aug 07 11:01:12.081270 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': 'b423c8be-dde1-4173-8d7b-cf9be55ee8ca'} Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca could not be found. Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:01:12.082179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca could not be found. Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca could not be found. Aug 07 11:01:12.083832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:12.085358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Returning 404 to user: Instance b423c8be-dde1-4173-8d7b-cf9be55ee8ca could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:01:12.085358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6bf7d461-1604-4543-a44b-bbeacfae558b tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca" status: 404 len: 111 microversion: 2.1 time: 0.033784 Aug 07 11:01:12.085358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 409/822] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:12 2022] GET /compute/v2.1/servers/b423c8be-dde1-4173-8d7b-cf9be55ee8ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 11:01:12.090278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4f1b3573-e876-4cba-99d2-65198dc4416f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] Calling method '.version_select at 0x7fc5ed91c5e0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:12.110888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4f1b3573-e876-4cba-99d2-65198dc4416f tempest-TestMinimumBasicScenario-206902706 tempest-TestMinimumBasicScenario-206902706-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-430952669" status: 202 len: 0 microversion: 2.1 time: 0.024244 Aug 07 11:01:12.111484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 414/823] 10.222.0.25 () {58 vars in 1269 bytes} [Sun Aug 7 11:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-430952669 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:01:12.702697 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:12.703348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:12.709168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:12.709654 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:12.710094 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:12.710787 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:12.711280 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:12.711705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:12.850562 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:12.859185 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9615a276-a317-46c6-ab22-3fe8641e2ef7 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.160188 Aug 07 11:01:12.859790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 410/824] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:12 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:13.882171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:13.882846 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:13.889564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:13.890050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:13.890482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:13.891207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:13.891687 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:13.892299 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:14.059665 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:14.068354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5f7b411-1729-4ed0-81c2-26a128a97b95 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.190615 Aug 07 11:01:14.069359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 415/825] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:13 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:15.089714 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:15.090461 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:15.092817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:15.097986 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:15.098520 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:15.098968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:15.099659 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:15.100107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:15.100519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:15.295609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:15.312853 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b09c6d0f-6776-46c5-a610-eb1c7e9b008b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.226869 Aug 07 11:01:15.313732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 411/826] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:15 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:16.333661 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:16.334181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:16.336635 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:16.342079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:16.342576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:16.343048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:16.343750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:16.344212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:16.344640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:16.845441 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:16.853034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4d1b2f0c-13af-4e43-98f1-235181e48066 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.523343 Aug 07 11:01:16.853962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 416/827] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:16 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:17.297941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:17.298450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:17.307662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.308307 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.308751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:17.309449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.310076 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.310504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:17.342343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e12b9db5-53e7-439c-9499-22f5cf256d28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments/778275a5-01ce-4701-8c34-509784c15ea2" status: 200 len: 194 microversion: 2.20 time: 0.048592 Aug 07 11:01:17.342944 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 412/828] 10.222.0.25 () {60 vars in 1454 bytes} [Sun Aug 7 11:01:17 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments/778275a5-01ce-4701-8c34-509784c15ea2 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 11:01:17.437701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:17.438114 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:17.450217 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.450709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.451172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:17.451881 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.452339 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.452765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:17.543650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lazy-loading 'services' on Instance uuid 72ec2284-c34f-4e70-b19f-4e762542600e {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:01:17.621255 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6966ab9a-73be-430d-93b3-914c5329cbf8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments/778275a5-01ce-4701-8c34-509784c15ea2" status: 202 len: 0 microversion: 2.20 time: 0.187846 Aug 07 11:01:17.621885 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 417/829] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Aug 7 11:01:17 2022] DELETE /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments/778275a5-01ce-4701-8c34-509784c15ea2 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:01:17.630212 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:17.632533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:17.641492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.642207 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.643235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:17.645106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.645554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.646410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:17.678597 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d173d085-3897-4633-a544-0e4b0e8a3c20 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052283 Aug 07 11:01:17.679299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 413/830] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Aug 7 11:01:17 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 11:01:17.877581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:17.878273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:17.895777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.896270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.896703 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:17.897404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:17.897857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:17.898286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:18.139996 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:18.149043 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7414f380-c04d-45f6-95a3-5bdc328ace56 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.275113 Aug 07 11:01:18.149874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 418/831] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:17 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:18.692047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:18.694182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:18.700698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:18.701184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:18.701620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:18.702314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:18.702772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:18.703216 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:18.735450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9fde22bc-b09b-46b4-8884-6e8089cbfb28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047454 Aug 07 11:01:18.736625 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 414/832] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Aug 7 11:01:18 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 11:01:19.175398 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:19.176598 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:19.184024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:19.184514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:19.185137 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:19.185868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:19.186493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:19.186916 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:19.420728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:19.429602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-253873a7-0cc3-43d1-8238-63573474521b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.260497 Aug 07 11:01:19.439740 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 419/833] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:19 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:19.749060 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:19.751910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:19.759517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:19.760097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:19.760558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:19.761421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:19.761873 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:19.762294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:19.793656 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f67ae1c3-c367-4294-894b-7cd8d863ccad tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049832 Aug 07 11:01:19.794335 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 415/834] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Aug 7 11:01:19 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 11:01:20.452023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:20.452749 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:20.461412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:20.462078 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:20.463224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:20.464519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:20.465502 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:20.466099 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:20.625090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:20.639402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c67ead12-f702-4e8f-b90d-45b13fc8efe1 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.192181 Aug 07 11:01:20.640011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 420/835] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:20 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:20.806807 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:20.809005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:20.815766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:20.816253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:20.816685 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:20.817384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:20.817832 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:20.818251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:20.850575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-16da9582-3cc7-43e5-bfa2-76d3501effa9 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048411 Aug 07 11:01:20.851202 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 416/836] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Aug 7 11:01:20 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:20.912783 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:20.913289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:20.919807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:20.920293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:20.920734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:20.921423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:20.921883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:20.922312 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:20.936957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:20.948983 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:01:21.027840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dc9adb1e-d190-4b9c-9446-6b9850f1370a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 204 len: 0 microversion: 2.20 time: 0.118341 Aug 07 11:01:21.028488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 421/837] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Aug 7 11:01:20 2022] DELETE /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 11:01:21.036892 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:21.037499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:21.043834 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:21.044315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:21.044747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:21.045423 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:21.045872 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:21.046289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:21.176269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:21.184781 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:21.186528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:21.187920 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a2378b98-225c-4371-93aa-916cbd9f6519 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.154841 Aug 07 11:01:21.188637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 417/838] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:21 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:21.662119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:21.662735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:21.669768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:21.670240 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:21.670665 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:21.671379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:21.671833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:21.672249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:21.804471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:21.812577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-41f8eb77-34ca-446e-9302-215fe0139247 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.154838 Aug 07 11:01:21.813148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 422/839] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:21 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:22.211772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:22.212913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:22.219635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:22.220140 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:22.220574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:22.221262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:22.221717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:22.222156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:22.352274 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:22.360993 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:22.362490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:22.363684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-81f05055-4052-47a3-8bbe-5010c6120b54 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.155799 Aug 07 11:01:22.364250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 418/840] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:22 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:22.833426 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:22.834060 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:22.841190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:22.841682 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:22.842119 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:22.842813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:22.843305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:22.843730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:22.976548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:22.984370 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8c7debc-609a-4539-b8ee-cdf8cba0b075 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.154894 Aug 07 11:01:22.984932 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 423/841] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:22 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:23.386100 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:23.386800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:23.393304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:23.393787 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:23.394224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:23.394934 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:23.395397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:23.395831 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:23.541797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:23.550232 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:23.552029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:23.553427 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7f6c4e12-c979-4f90-9fe2-5b18f630468e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1723 microversion: 2.20 time: 0.171275 Aug 07 11:01:23.554299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 419/842] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:23 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:23.604485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-0a21b1cf-9157-413c-95b4-5e0fca1cc93e req-c875fedc-76c0-4d39-b830-3ee90a25c5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223548c0-1e24-46fc-8238-56a431aadfd0", "name": "network-vif-plugged", "status": "completed", "tag": "2d0a513b-66b5-4ab9-9279-4055a67679fb"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:23.615864 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0a21b1cf-9157-413c-95b4-5e0fca1cc93e req-c875fedc-76c0-4d39-b830-3ee90a25c5bf service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:23.616564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0a21b1cf-9157-413c-95b4-5e0fca1cc93e req-c875fedc-76c0-4d39-b830-3ee90a25c5bf service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:23.617183 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0a21b1cf-9157-413c-95b4-5e0fca1cc93e req-c875fedc-76c0-4d39-b830-3ee90a25c5bf service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:23.629594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-0a21b1cf-9157-413c-95b4-5e0fca1cc93e req-c875fedc-76c0-4d39-b830-3ee90a25c5bf service nova] Creating event network-vif-plugged:2d0a513b-66b5-4ab9-9279-4055a67679fb for instance 223548c0-1e24-46fc-8238-56a431aadfd0 on hv-cinder-85032 Aug 07 11:01:23.635649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-0a21b1cf-9157-413c-95b4-5e0fca1cc93e req-c875fedc-76c0-4d39-b830-3ee90a25c5bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 Aug 07 11:01:23.636435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 424/843] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:01:24.005640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:24.006253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:24.012705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:24.013195 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:24.013628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:24.014322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:24.014775 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:24.015225 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:24.313385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:24.322854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a40aff78-a402-42b3-85e0-b3d8f3da414c tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.320433 Aug 07 11:01:24.332060 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 420/844] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:24 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:24.352893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-7bbcd8fc-9a88-47e6-9760-dcaf8c2b1a6b req-86aa3578-451b-4095-8df4-c079095703be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ec2284-c34f-4e70-b19f-4e762542600e", "name": "network-vif-deleted", "tag": "90ed1281-54b7-4284-9826-dc980d8a465a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:24.362716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7bbcd8fc-9a88-47e6-9760-dcaf8c2b1a6b req-86aa3578-451b-4095-8df4-c079095703be service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:24.363298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7bbcd8fc-9a88-47e6-9760-dcaf8c2b1a6b req-86aa3578-451b-4095-8df4-c079095703be service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:24.363794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7bbcd8fc-9a88-47e6-9760-dcaf8c2b1a6b req-86aa3578-451b-4095-8df4-c079095703be service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:24.376028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-7bbcd8fc-9a88-47e6-9760-dcaf8c2b1a6b req-86aa3578-451b-4095-8df4-c079095703be service nova] Creating event network-vif-deleted:90ed1281-54b7-4284-9826-dc980d8a465a for instance 72ec2284-c34f-4e70-b19f-4e762542600e on hv-cinder-85032 Aug 07 11:01:24.382970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-7bbcd8fc-9a88-47e6-9760-dcaf8c2b1a6b req-86aa3578-451b-4095-8df4-c079095703be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034758 Aug 07 11:01:24.383594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 425/845] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:24.579184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:24.579926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:24.586518 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:24.587051 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:24.587918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:24.588809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:24.589426 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:24.589851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:24.655807 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:24.663557 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:24.665067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:24.666835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e078b919-ffd3-4c41-96b4-6dbf9b379b42 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1655 microversion: 2.20 time: 0.092691 Aug 07 11:01:24.667428 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 421/846] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:24 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:25.344493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:25.346345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:25.353122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:25.354260 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:25.354700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:25.355441 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:25.355898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:25.356321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:25.689583 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:25.690204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:25.697501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:25.697996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:25.698430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:25.699173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:25.699635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:25.700062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:25.729059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:25.730843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:25.731355 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:25.731791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:25.732242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lazy-loading 'fault' on Instance uuid 72ec2284-c34f-4e70-b19f-4e762542600e {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:01:25.736808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-97c3248b-faa4-4f14-ada0-1ecf1edd3099 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1577 microversion: 2.1 time: 0.396563 Aug 07 11:01:25.737454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 426/847] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:25 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1577 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:25.774622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:25.783800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:25.785298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:25.786452 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8c855286-9bf6-45e9-b6e8-1d157486b2ef tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 200 len: 1372 microversion: 2.20 time: 0.100789 Aug 07 11:01:25.787023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 422/848] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:25 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:01:26.757631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:26.758236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:26.765398 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:26.765878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:26.766309 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:26.767022 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:26.767476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:26.767899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:26.810311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:26.810934 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:26.817351 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:26.817826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:26.818252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:26.818957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:26.819409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:26.819829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:26.834021 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] HTTP exception thrown: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Request method failure captured: Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e HTTP/1.1 Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nd-PlvLC6NWIPVGiKlf5k1a5PmdUw5MsiqzJf6qAEfydbndj4TMrOqLZZ5SPFo_9gkEOJXWCrbbga59oV5UTupJnNmzWX0fHf-CQAlJts3XFLKAHCDWrTDw43ODQqit_U7KbfEANZCFzRLOTHkJsBUg8WdLhIRiLteoUyzo1puVYM Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:01:26.835579 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f23b23bf2f84fdf8401acf4d73e1f4b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 2b757e3f47e44b9ba3645d12b20f7502 Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:01:26.837228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '72ec2284-c34f-4e70-b19f-4e762542600e'} Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:01:26.838054 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:01:26.840091 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:26.841170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Returning 404 to user: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:01:26.841170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48476dff-b7eb-4cc5-ac49-2064a186378e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 404 len: 111 microversion: 2.20 time: 0.031263 Aug 07 11:01:26.841170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 423/849] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:26 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 11:01:26.846364 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a5cafef9-63a2-4b31-b2f1-5b0db4ac7d35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '.version_select at 0x7fc5ed963280>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:26.874308 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a5cafef9-63a2-4b31-b2f1-5b0db4ac7d35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125088591" status: 204 len: 0 microversion: 2.20 time: 0.031520 Aug 07 11:01:26.875725 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 424/850] 10.222.0.25 () {60 vars in 1262 bytes} [Sun Aug 7 11:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125088591 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 11:01:26.904063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:26.912106 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-be1b897b-0931-46a6-bb3a-6424fc230a5b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1564 microversion: 2.1 time: 0.158352 Aug 07 11:01:26.912678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 427/851] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:26 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:27.596111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-613a41b2-b98f-4790-9665-3f5a1d2493ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'create', calling method: .version_select at 0x7fc5ed833f70>, body: {"keypair": {"name": "tempest-keypair-172137760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI92mZ7gC4BDS1jyL4SRxWJ7EkEzZXjYudGXJ+//eDLSt6nLrE/1XqE0DRI7NDPNWbjSObFdAGmxAw3BcipETikGBPScYaaZscA+4/MtC448k96ZFtDSrE+xuB0vBVBilA=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:27.615793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-613a41b2-b98f-4790-9665-3f5a1d2493ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:01:27.619811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-613a41b2-b98f-4790-9665-3f5a1d2493ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for user 2b757e3f47e44b9ba3645d12b20f7502 and project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:01:27.644522 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-613a41b2-b98f-4790-9665-3f5a1d2493ab tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052320 Aug 07 11:01:27.645292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 425/852] 10.222.0.25 () {62 vars in 1200 bytes} [Sun Aug 7 11:01:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 11:01:29.150124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-721785478", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b8ae6a5-9495-4ad7-8f30-6fd8ff3dd376"}], "security_groups": [{"name": "tempest-securitygroup--1984557422"}], "key_name": "tempest-keypair-172137760", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:29.256519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] validate_networks() for [('4b8ae6a5-9495-4ad7-8f30-6fd8ff3dd376', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:01:29.627569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:01:29.628002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:01:29.628484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:01:29.628898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:01:29.629311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:01:29.638482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:29.639000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:29.639438 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:29.640165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:29.640626 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:29.641049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:29.658027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:01:29.661924 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Getting quotas for user 2b757e3f47e44b9ba3645d12b20f7502 and project 1f23b23bf2f84fdf8401acf4d73e1f4b. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:01:29.673496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:01:29.675806 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:01:29.722506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a7086db7-33ca-4640-a856-686ecfc4e8bd tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.576632 Aug 07 11:01:29.723200 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 428/853] 10.222.0.25 () {62 vars in 1188 bytes} [Sun Aug 7 11:01:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 11:01:29.734825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-16788f78-d473-4a40-8ff3-d403dc0b76b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:29.735483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-16788f78-d473-4a40-8ff3-d403dc0b76b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:29.788912 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-16788f78-d473-4a40-8ff3-d403dc0b76b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:29.796281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-16788f78-d473-4a40-8ff3-d403dc0b76b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:29.797815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-16788f78-d473-4a40-8ff3-d403dc0b76b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:29.798939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-16788f78-d473-4a40-8ff3-d403dc0b76b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1280 microversion: 2.20 time: 0.068736 Aug 07 11:01:29.799506 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 426/854] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:29 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:30.822151 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:30.822759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:30.830222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:30.830715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:30.831182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:30.831917 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:30.832383 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:30.832807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:30.910375 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:30.919779 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:30.921283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:30.922401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6283b8f6-773d-4f10-9f05-254e60797ca4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1340 microversion: 2.20 time: 0.104838 Aug 07 11:01:30.922978 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 429/855] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:30 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1340 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:31.945391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:31.945909 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:31.952926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:31.953406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:31.953831 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:31.954521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:31.954987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:31.955406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:32.088309 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:32.096958 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:32.098793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:32.099945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4c554f32-3f8e-4a71-8af8-325140ce768c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1406 microversion: 2.20 time: 0.158481 Aug 07 11:01:32.100528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 427/856] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:31 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:01:32.253886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-c67fd854-aa08-4df0-a1c7-71d8a4a57bf1 req-5b1940d2-300e-4e89-a2a6-51ffc541e38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3", "tag": "1bfe5de2-026e-41d4-bd13-82bed6308b7d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:32.266785 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c67fd854-aa08-4df0-a1c7-71d8a4a57bf1 req-5b1940d2-300e-4e89-a2a6-51ffc541e38b service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:32.267215 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c67fd854-aa08-4df0-a1c7-71d8a4a57bf1 req-5b1940d2-300e-4e89-a2a6-51ffc541e38b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:32.267647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c67fd854-aa08-4df0-a1c7-71d8a4a57bf1 req-5b1940d2-300e-4e89-a2a6-51ffc541e38b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:32.279382 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-c67fd854-aa08-4df0-a1c7-71d8a4a57bf1 req-5b1940d2-300e-4e89-a2a6-51ffc541e38b service nova] Creating event network-changed:1bfe5de2-026e-41d4-bd13-82bed6308b7d for instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 on hv-cinder-85032 Aug 07 11:01:32.284302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-c67fd854-aa08-4df0-a1c7-71d8a4a57bf1 req-5b1940d2-300e-4e89-a2a6-51ffc541e38b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Aug 07 11:01:32.284962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 430/857] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:01:33.124058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:33.124692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:33.131095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:33.131570 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:33.131997 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:33.132674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:33.133121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:33.133536 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:33.148291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=100 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:33.259743 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:33.268169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:33.269643 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:33.270744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-21bdf729-cc60-469b-8d7b-d65253ae463e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1406 microversion: 2.20 time: 0.150606 Aug 07 11:01:33.271320 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 428/858] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:33 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:34.295202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:34.295897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:34.302058 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:34.302548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:34.303075 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:34.303696 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:34.304153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:34.304603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:34.433172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:34.441220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:34.442711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:34.443894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-abb4cb10-c68e-4d01-b6dd-0b465b23d622 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1406 microversion: 2.20 time: 0.154399 Aug 07 11:01:34.444456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 431/859] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:34 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:35.465745 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:35.467196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:35.473718 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:35.474229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:35.474663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:35.475368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:35.475816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:35.476378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:35.615242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:35.624342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:35.625838 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:35.626969 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b93eb6b4-7ba3-4c4c-8ede-9974feee061e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1406 microversion: 2.20 time: 0.165157 Aug 07 11:01:35.634196 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 429/860] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:35 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:36.650388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:36.651026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:36.657029 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:36.657517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:36.657988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:36.658710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:36.659199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:36.659629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:36.786805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:36.794690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:36.796245 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:36.797358 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a7fd22eb-32d1-49ae-9ec7-c406d6acbfda tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1406 microversion: 2.20 time: 0.151026 Aug 07 11:01:36.797911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 432/861] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:36 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:37.674300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-dec9e553-74b0-4a82-9aef-b6b0b9e4336a req-06b063a4-1419-480b-aee4-efe44f5c7fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3", "name": "network-vif-plugged", "status": "completed", "tag": "1bfe5de2-026e-41d4-bd13-82bed6308b7d"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:37.684722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-dec9e553-74b0-4a82-9aef-b6b0b9e4336a req-06b063a4-1419-480b-aee4-efe44f5c7fae service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:37.685293 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-dec9e553-74b0-4a82-9aef-b6b0b9e4336a req-06b063a4-1419-480b-aee4-efe44f5c7fae service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:37.685719 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-dec9e553-74b0-4a82-9aef-b6b0b9e4336a req-06b063a4-1419-480b-aee4-efe44f5c7fae service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:37.696900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-dec9e553-74b0-4a82-9aef-b6b0b9e4336a req-06b063a4-1419-480b-aee4-efe44f5c7fae service nova] Creating event network-vif-plugged:1bfe5de2-026e-41d4-bd13-82bed6308b7d for instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 on hv-cinder-85032 Aug 07 11:01:37.702749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-dec9e553-74b0-4a82-9aef-b6b0b9e4336a req-06b063a4-1419-480b-aee4-efe44f5c7fae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032154 Aug 07 11:01:37.703481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 430/862] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:37.818543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:37.819380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:37.826856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:37.827380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:37.827816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:37.828515 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:37.828999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:37.829423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:37.974328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:37.982457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:37.984329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:37.985553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-818302bb-8c38-4bc6-acbb-e26328af4914 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1406 microversion: 2.20 time: 0.171044 Aug 07 11:01:37.986191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 433/863] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:37 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:39.009016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:39.009707 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:39.016401 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:39.016873 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:39.017299 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:39.018007 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:39.018455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:39.018873 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:39.147997 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:39.155859 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:39.157335 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:39.158424 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b0e1903b-fdb2-4c65-8cc0-35a45666d2fe tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1406 microversion: 2.20 time: 0.154195 Aug 07 11:01:39.158989 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 431/864] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:39 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:40.181222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:40.181765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:40.184205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:40.184916 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:40.191336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:40.191940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:40.192456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:40.193223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:40.193709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:40.194211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:40.329728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:40.337734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:40.339272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:40.340431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-217ba0d9-b2dc-41f3-b275-79c697befb3d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1598 microversion: 2.20 time: 0.163244 Aug 07 11:01:40.340990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 434/865] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:01:40 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:01:40.362533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:40.363053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:40.364950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:40.371391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:40.371871 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:40.372311 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:40.372997 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:40.373450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:40.373869 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:40.449940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1190784a-80d8-4a37-85da-4ad3d4617bd8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091460 Aug 07 11:01:40.450530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 432/866] 10.222.0.25 () {60 vars in 1316 bytes} [Sun Aug 7 11:01:40 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 11:01:41.368575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e375c493-4b0e-454c-9675-36cb11573cab req-0c4bdb15-eca1-4e65-b444-09b3eccba46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3", "tag": "1bfe5de2-026e-41d4-bd13-82bed6308b7d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:41.379201 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e375c493-4b0e-454c-9675-36cb11573cab req-0c4bdb15-eca1-4e65-b444-09b3eccba46a service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:41.379872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e375c493-4b0e-454c-9675-36cb11573cab req-0c4bdb15-eca1-4e65-b444-09b3eccba46a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:41.380311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e375c493-4b0e-454c-9675-36cb11573cab req-0c4bdb15-eca1-4e65-b444-09b3eccba46a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:41.391439 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e375c493-4b0e-454c-9675-36cb11573cab req-0c4bdb15-eca1-4e65-b444-09b3eccba46a service nova] Creating event network-changed:1bfe5de2-026e-41d4-bd13-82bed6308b7d for instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 on hv-cinder-85032 Aug 07 11:01:41.396591 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e375c493-4b0e-454c-9675-36cb11573cab req-0c4bdb15-eca1-4e65-b444-09b3eccba46a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 Aug 07 11:01:41.397335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 435/867] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:50.461819 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:50.462604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=21 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:50.562258 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:50.564963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:50.566951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:50.572401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.572900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.573342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.574242 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.574707 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.575156 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.609290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-92c77d9d-4c25-4608-b1ab-a495aa12a5fa tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052944 Aug 07 11:01:50.609870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 436/868] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:50 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 11:01:50.642092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:50.642584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:50.648495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.648974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.649408 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.650085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.650532 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.650971 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.672722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:50.673321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:50.673756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3a242a8b-d4cb-4053-943a-13afdb585ac1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd/ips" status: 200 len: 150 microversion: 2.1 time: 0.213310 Aug 07 11:01:50.674300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 433/869] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 11:01:50 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd/ips => generated 150 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:50.679623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.680229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.680670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.681535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.681993 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.682419 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.685759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9a00ee-17f1-4b9f-b89e-22571da59c98"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:50.688229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:50.694008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.694486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.694934 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.695627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.696076 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.696490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.708803 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:01:50.778313 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Invalid volume: volume 0d9a00ee-17f1-4b9f-b89e-22571da59c98 is already attached to instances: 71bde61e-a4b4-4a6c-87dc-23390b24133c Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd/os-volume_attachments HTTP/1.1 Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 74 Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:01:50.780300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {"volumeAttachment": {"volumeId": "0d9a00ee-17f1-4b9f-b89e-22571da59c98"}} Aug 07 11:01:50.781768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Invalid volume: volume 0d9a00ee-17f1-4b9f-b89e-22571da59c98 is already attached to instances: 71bde61e-a4b4-4a6c-87dc-23390b24133c Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '5389db54-ca87-4ac8-878c-08eddf5676dd', 'body': {'volumeAttachment': {'volumeId': '0d9a00ee-17f1-4b9f-b89e-22571da59c98'}}} Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d9a00ee-17f1-4b9f-b89e-22571da59c98 is already attached to instances: 71bde61e-a4b4-4a6c-87dc-23390b24133c Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:50.782605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d9a00ee-17f1-4b9f-b89e-22571da59c98 is already attached to instances: 71bde61e-a4b4-4a6c-87dc-23390b24133c Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:01:50.783868 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d9a00ee-17f1-4b9f-b89e-22571da59c98 is already attached to instances: 71bde61e-a4b4-4a6c-87dc-23390b24133c Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 400 to user: Invalid volume: volume 0d9a00ee-17f1-4b9f-b89e-22571da59c98 is already attached to instances: 71bde61e-a4b4-4a6c-87dc-23390b24133c {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7c8a9718-819f-4bc7-8b23-34fc2d17f81e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100408 Aug 07 11:01:50.785090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 434/870] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 11:01:50 2022] POST /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 11:01:50.789720 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d0b012a8-a113-474c-93af-6b567a1ee388 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 204 len: 0 microversion: 2.1 time: 0.118971 Aug 07 11:01:50.791027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 437/871] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:01:50 2022] DELETE /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:01:50.793240 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:50.793960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:50.800194 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:50.801035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:50.801577 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.802215 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.802809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.803673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.804171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.804597 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.807963 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.808484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.808928 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.809647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.810109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.810537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.815183 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:50.833793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:01:50.913116 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2ce354f2-ba38-4477-be35-eb1f31bd982f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 204 len: 0 microversion: 2.1 time: 0.124923 Aug 07 11:01:50.913915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 435/872] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:01:50 2022] DELETE /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:01:50.922301 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:50.923076 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:50.929265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.929748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.930382 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.931133 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:50.931583 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:50.932001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:50.958171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:50.966870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c6e1da9f-2222-4c3d-87a4-e5c844b2a9ce tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1674 microversion: 2.1 time: 0.171138 Aug 07 11:01:50.967484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 438/873] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:50 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:51.063356 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:51.070830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8600bcb7-6520-4cba-9813-82017d9b105d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1680 microversion: 2.1 time: 0.152710 Aug 07 11:01:51.071422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 436/874] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:50 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:01:51.365406 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:51.365908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:51.372376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:51.372864 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:51.373313 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:51.374009 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:51.374468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:51.374897 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:51.455407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lazy-loading 'services' on Instance uuid edf03e0d-d4df-471c-a17e-db0ab8dbbc1f {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:01:51.525926 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c8cc8a5d-e13e-4b59-82f5-2ed1a2128377 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments/e40f40c2-0cde-422c-a16b-b203192c1230" status: 202 len: 0 microversion: 2.1 time: 0.164246 Aug 07 11:01:51.526509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 439/875] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:01:51 2022] DELETE /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments/e40f40c2-0cde-422c-a16b-b203192c1230 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:01:51.534826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:51.537083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:51.544202 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:51.544677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:51.545104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:51.545782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:51.546231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:51.546647 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:51.576841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-51ef1abd-c200-4cd0-b33a-a0b7361a6e32 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Aug 07 11:01:51.577313 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 437/876] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:51 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:51.988815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:51.989441 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:51.995669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:51.996154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:51.996596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:51.997289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:51.997751 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:51.998182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:52.094675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:52.095642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:52.101169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:52.101654 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:52.102085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:52.102772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:52.103256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:52.103676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:52.133150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:52.141828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2e4cd504-b372-4286-b914-09245e68231d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1674 microversion: 2.1 time: 0.157767 Aug 07 11:01:52.142508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 440/877] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:51 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:52.230969 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:52.238540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f5c5c60-fd7f-46f0-95e2-6d871a9ed367 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1680 microversion: 2.1 time: 0.149802 Aug 07 11:01:52.239172 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 438/878] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:52 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:01:52.589065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:52.591656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:52.597652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:52.598129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:52.598558 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:52.599280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:52.599767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:52.600186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:52.629352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ea8a184d-17e7-4f94-890c-b34f90a30481 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Aug 07 11:01:52.629896 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 441/879] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:52 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:53.163451 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:53.163987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:53.170221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:53.170697 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:53.171173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:53.171854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:53.172303 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:53.172722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:53.259388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:53.260093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:53.267274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:53.267865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:53.268376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:53.269146 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:53.269678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:53.270113 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:53.318442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:53.326684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-28a3b32d-17a6-43fd-9ca4-d137239ce8df tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1674 microversion: 2.1 time: 0.167177 Aug 07 11:01:53.327354 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 439/880] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:53 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:53.409499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:53.417125 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e6a6bbc7-38a5-4570-b600-e43842592376 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1680 microversion: 2.1 time: 0.161533 Aug 07 11:01:53.417714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 442/881] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:53 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:01:53.640668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:53.642802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:53.648682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:53.649166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:53.649602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:53.650297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:53.650749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:53.651200 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:53.679878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f0d475bd-b514-42f2-af37-b3fb37101792 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Aug 07 11:01:53.680389 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 440/882] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:53 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:54.347737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:54.348348 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:54.354833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:54.355892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:54.356327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:54.357042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:54.357481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:54.357905 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:54.440800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:54.441634 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:54.449170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:54.449884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:54.450392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:54.451195 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:54.452008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:54.452596 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:54.536291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:54.548111 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-08b12644-ba5c-4c34-a066-cdf93e0fd77e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1674 microversion: 2.1 time: 0.203332 Aug 07 11:01:54.562958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 443/883] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:54 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:54.607564 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:54.615269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5dcb8d95-b4fa-4150-8df6-989137252edb tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1680 microversion: 2.1 time: 0.178957 Aug 07 11:01:54.615827 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 441/884] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:54 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:01:54.693044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:54.695365 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:54.701394 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:54.701878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:54.702314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:54.703037 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:54.703498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:54.703924 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:54.734408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3e16d172-abb0-4ac0-b28f-eccef94fcc4f tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Aug 07 11:01:54.735000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 444/885] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:54 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:55.569730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:55.570343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:55.577009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.577499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.578253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.578965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.579426 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.579893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.637064 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:55.637811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:55.646465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.646987 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.647434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.648145 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.648609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.649036 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.666337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:55.677157 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-852b1784-81bc-4e06-9f4c-2fc9faf224a9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1606 microversion: 2.1 time: 0.111301 Aug 07 11:01:55.678625 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 442/886] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:55 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1606 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:55.746421 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:55.748924 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:55.751638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:55.760857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5f8cf285-2b44-4b07-9583-974d8d7bbbc9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1613 microversion: 2.1 time: 0.127708 Aug 07 11:01:55.761731 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.774859 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.774859 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.775341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 445/887] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:55 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1613 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:55.775436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.775436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.775436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.818509 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-55114372-7fc3-4849-a1af-7ee3fdc36381 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076603 Aug 07 11:01:55.819952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 443/888] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:01:55 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 11:01:55.927047 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:55.927938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:55.936476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.937354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.938088 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.939469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:55.940039 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:55.940560 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:55.972700 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:01:56.071462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f3a652a6-772a-499b-8984-1076c2d2e672 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 204 len: 0 microversion: 2.1 time: 0.148093 Aug 07 11:01:56.072505 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 446/889] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:01:55 2022] DELETE /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:01:56.082080 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:56.083040 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:56.090105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:56.090912 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:56.091547 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:56.092409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:56.093018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:56.093606 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:56.127510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-40aa4fbf-5c0a-45b8-8f7c-e67208fa3bb5 req-dce0e078-894b-41d7-8b45-470661bae6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad22310-bbff-4a4d-b3e1-08f2f0ee19bb", "name": "network-vif-deleted", "tag": "7241f531-f113-4b1c-85e1-d78a8ccecdf7"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:56.137906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-40aa4fbf-5c0a-45b8-8f7c-e67208fa3bb5 req-dce0e078-894b-41d7-8b45-470661bae6ef service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:56.138494 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-40aa4fbf-5c0a-45b8-8f7c-e67208fa3bb5 req-dce0e078-894b-41d7-8b45-470661bae6ef service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:56.139106 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-40aa4fbf-5c0a-45b8-8f7c-e67208fa3bb5 req-dce0e078-894b-41d7-8b45-470661bae6ef service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:56.176586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-40aa4fbf-5c0a-45b8-8f7c-e67208fa3bb5 req-dce0e078-894b-41d7-8b45-470661bae6ef service nova] Creating event network-vif-deleted:7241f531-f113-4b1c-85e1-d78a8ccecdf7 for instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb on hv-cinder-85032 Aug 07 11:01:56.188425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-40aa4fbf-5c0a-45b8-8f7c-e67208fa3bb5 req-dce0e078-894b-41d7-8b45-470661bae6ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064791 Aug 07 11:01:56.189410 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 447/890] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:56.261851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:56.269788 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-822a1bd3-76a9-48bd-92a6-ded45205c3f6 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1691 microversion: 2.1 time: 0.192599 Aug 07 11:01:56.281230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 444/891] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:56 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:56.701805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:56.702667 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:56.709876 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:56.710459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:56.710901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:56.711662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:56.712116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:56.712576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:56.777832 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:56.781822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:56.783034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:56.786971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-91463f65-ecb2-491a-a4a7-90bfcfbd5f97 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1606 microversion: 2.1 time: 0.089585 Aug 07 11:01:56.788026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 448/892] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:56 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1606 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:56.799822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:56.800535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:56.801108 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:56.801971 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:56.802576 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:56.803303 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:56.878135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:56.886221 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a076c306-e75c-4cac-b702-c2a424671413 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1613 microversion: 2.1 time: 0.108289 Aug 07 11:01:56.899067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 445/893] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:56 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:57.291286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:57.291818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:57.298145 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:57.298623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:57.299091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:57.299777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:57.300232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:57.300656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:57.437629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:57.445252 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-47a2d95e-c88d-4f12-bb1c-b89e8e248210 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1691 microversion: 2.1 time: 0.157965 Aug 07 11:01:57.445810 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 449/894] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:57 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:57.807549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:57.808413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:57.814879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:57.815395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:57.815824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:57.816507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:57.816959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:57.817380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:57.878532 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:57.885999 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8965dcbd-a3c2-45b6-9bbd-701d36f8fddc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1606 microversion: 2.1 time: 0.082262 Aug 07 11:01:57.886692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 446/895] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:57 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1606 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:57.907552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:57.908173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:57.914611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:57.915138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:57.915576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:57.916265 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:57.916719 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:57.917143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:57.980730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:57.988453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f18aa618-18d5-44bf-80d3-1f179856a724 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1613 microversion: 2.1 time: 0.084716 Aug 07 11:01:57.989013 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 450/896] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:57 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:58.205188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-671916dc-0c1a-4d56-83b0-9644ade08c94 req-7c806ffa-0925-4013-b79c-6581e1ac889f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5389db54-ca87-4ac8-878c-08eddf5676dd", "name": "network-vif-deleted", "tag": "cc0d1fc5-e58e-4e21-800b-9ea5222c59d2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:01:58.215285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-671916dc-0c1a-4d56-83b0-9644ade08c94 req-7c806ffa-0925-4013-b79c-6581e1ac889f service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:58.215761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-671916dc-0c1a-4d56-83b0-9644ade08c94 req-7c806ffa-0925-4013-b79c-6581e1ac889f service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:58.216185 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-671916dc-0c1a-4d56-83b0-9644ade08c94 req-7c806ffa-0925-4013-b79c-6581e1ac889f service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:58.226700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-671916dc-0c1a-4d56-83b0-9644ade08c94 req-7c806ffa-0925-4013-b79c-6581e1ac889f service nova] Creating event network-vif-deleted:cc0d1fc5-e58e-4e21-800b-9ea5222c59d2 for instance 5389db54-ca87-4ac8-878c-08eddf5676dd on hv-cinder-85032 Aug 07 11:01:58.231785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-671916dc-0c1a-4d56-83b0-9644ade08c94 req-7c806ffa-0925-4013-b79c-6581e1ac889f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030157 Aug 07 11:01:58.232391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 447/897] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:01:58.466431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:58.467011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:58.472977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:58.473464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:58.473904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:58.474596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:58.475085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:58.475510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:58.606541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:58.614263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d91d4e4-98dc-4c84-9a78-e40400a2c251 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1691 microversion: 2.1 time: 0.152797 Aug 07 11:01:58.614826 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 451/898] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:58 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:58.910109 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:58.911097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:58.917702 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:58.918181 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:58.918611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:58.919444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:58.920104 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:58.920536 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:58.981605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:58.985325 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:58.990166 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2fc3ca12-cfd3-4979-a785-9c774b6d029e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1606 microversion: 2.1 time: 0.084234 Aug 07 11:01:58.990712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 448/899] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:58 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:59.009004 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:59.009609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:59.016506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:59.016982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:59.017411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:59.018087 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:59.018537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:59.018998 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:59.079568 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:59.086888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fd9dd02d-4d29-401f-b116-29c80d57230c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1613 microversion: 2.1 time: 0.081753 Aug 07 11:01:59.087482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 452/900] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:59 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1613 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:01:59.636056 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:01:59.637180 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:01:59.644757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:59.645273 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:59.645706 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:59.646410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:01:59.646866 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:01:59.647501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:01:59.777840 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:01:59.788455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d55b2abf-4419-45fe-9722-2f519db98934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1691 microversion: 2.1 time: 0.156755 Aug 07 11:01:59.789061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 449/901] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:01:59 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:00.011954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:00.012583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:00.019381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.019866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.020326 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.021019 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.021481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.021908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.024604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:00.053860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.054340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.054776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.055250 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lazy-loading 'fault' on Instance uuid cad22310-bbff-4a4d-b3e1-08f2f0ee19bb {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:02:00.098809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:00.106599 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a188e119-b169-449e-b41c-cec98deddfde tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 200 len: 1326 microversion: 2.1 time: 0.099216 Aug 07 11:02:00.107201 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 453/902] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:00 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:00.108890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:00.109647 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:00.116063 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.116553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.116993 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.117693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.118155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.118582 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.149890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.150372 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.150811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.151283 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lazy-loading 'fault' on Instance uuid 5389db54-ca87-4ac8-878c-08eddf5676dd {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:02:00.190623 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:00.200650 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-73b09770-c1b5-4e30-94de-d2701bbbd5f0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 200 len: 1330 microversion: 2.1 time: 0.095818 Aug 07 11:02:00.201223 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 450/903] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:00 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:02:00.810203 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:00.810812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:00.817109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.817646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.818148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.819097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:00.819562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:00.819997 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:00.954219 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:00.962738 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ad46801e-890c-4b9b-89d5-ecf601b5b4ff tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1691 microversion: 2.1 time: 0.157008 Aug 07 11:02:00.963340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 454/904] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:00 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:01.130154 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:01.130775 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:01.137519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:01.138097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:01.138537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:01.139263 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:01.139714 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:01.140132 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:01.153369 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] HTTP exception thrown: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Request method failure captured: Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb HTTP/1.1 Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nmzfkIRqeqbdI3lBZyHB6h7-fcfW9ujMcwLrD_gguPZHYxPxpZvT3lq-msT3u3W0s7w9leoHl1_Qzikz_uQ1rnZjbYESxtr6xtLFKx5MlXzbN3BdDC3wzYn5q4o10AxGSTVcGE5qKuT7IX0cocL8MAM4VOLZXHw-1Dk6jrro88SjU Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:02:01.155145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c3be73ff916420f8c9eb418ef5f6716", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 2b64b05230b940eba992a063ea7cd778 Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:02:01.156734 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': 'cad22310-bbff-4a4d-b3e1-08f2f0ee19bb'} Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:02:01.157692 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:02:01.159149 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.160496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Returning 404 to user: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:02:01.160496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-66327c15-f9a9-44fd-aef9-04dc87147c0c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 404 len: 111 microversion: 2.1 time: 0.031828 Aug 07 11:02:01.160496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 451/905] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:01 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:02:01.173220 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dcf4be1d-c6b1-4bcd-9394-9ab8ae389e7e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '.version_select at 0x7fc5ed9b2ee0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:01.206900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dcf4be1d-c6b1-4bcd-9394-9ab8ae389e7e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-893025530" status: 202 len: 0 microversion: 2.1 time: 0.045208 Aug 07 11:02:01.208118 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 455/906] 10.222.0.25 () {58 vars in 1218 bytes} [Sun Aug 7 11:02:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-893025530 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:02:01.221742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:01.222366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:01.228434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:01.228920 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:01.229360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:01.230602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:01.231093 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:01.231523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:01.245191 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd HTTP/1.1 Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:02:01.247267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:02:01.248941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '5389db54-ca87-4ac8-878c-08eddf5676dd'} Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:02:01.249757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:02:01.251272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:01.253105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:02:01.253105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b2187379-f900-4517-8764-d9be8f1615d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 404 len: 111 microversion: 2.1 time: 0.030909 Aug 07 11:02:01.253105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 452/907] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:01 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:02:01.257649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c9ffb55d-8227-4e93-b6e3-2cfcc0f85a9c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '.version_select at 0x7fc5eda0c310>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:01.277233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c9ffb55d-8227-4e93-b6e3-2cfcc0f85a9c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142719322" status: 202 len: 0 microversion: 2.1 time: 0.023361 Aug 07 11:02:01.277928 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 456/908] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Aug 7 11:02:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142719322 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:02:01.699828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-1dd2a82a-6304-49c5-a9c6-88556b795af3 req-4b1193bf-104b-4bef-8c42-79fd81f0a13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf03e0d-d4df-471c-a17e-db0ab8dbbc1f", "name": "network-vif-deleted", "tag": "8f5e1d77-61de-4709-a023-e0d9df750ea5"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:01.724594 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1dd2a82a-6304-49c5-a9c6-88556b795af3 req-4b1193bf-104b-4bef-8c42-79fd81f0a13c service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:01.727066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1dd2a82a-6304-49c5-a9c6-88556b795af3 req-4b1193bf-104b-4bef-8c42-79fd81f0a13c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:01.727566 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-1dd2a82a-6304-49c5-a9c6-88556b795af3 req-4b1193bf-104b-4bef-8c42-79fd81f0a13c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:01.768697 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-1dd2a82a-6304-49c5-a9c6-88556b795af3 req-4b1193bf-104b-4bef-8c42-79fd81f0a13c service nova] Creating event network-vif-deleted:8f5e1d77-61de-4709-a023-e0d9df750ea5 for instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f on hv-cinder-85032 Aug 07 11:02:01.780703 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-1dd2a82a-6304-49c5-a9c6-88556b795af3 req-4b1193bf-104b-4bef-8c42-79fd81f0a13c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085236 Aug 07 11:02:01.781662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 453/909] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:01.985634 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:01.986306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:02.008518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:02.009999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:02.010640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:02.012124 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:02.012588 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:02.013011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:02.050608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:02.051241 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:02.051890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:02.052528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lazy-loading 'fault' on Instance uuid edf03e0d-d4df-471c-a17e-db0ab8dbbc1f {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:02:02.118517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:02.127613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6641ae4a-b780-4897-a55a-01d2dc45a6e8 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 200 len: 1336 microversion: 2.1 time: 0.146969 Aug 07 11:02:02.138962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 457/910] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:01 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 1336 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:02.177940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:02.178554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:02.185005 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:02.185507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:02.186024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:02.186939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:02.187800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:02.188392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:02.224320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4507a2c3-f895-458e-a0e4-b59a86b99c3c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'create', calling method: .version_select at 0x7fc5ed980ca0>, body: {"keypair": {"name": "tempest-keypair-1464950634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBuL2d6+SAN1+N79i11CeRNRh7o4OTHGrcTNR2+/k5l1MwTrZJil47JxHD2FtV6NDDWz32ZUrZNSRUtH1ZWGr8SnJTKejabum9pNmf0CjBQWhIIPei9tEhwXwdvQKX+7Q=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:02.242149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-4507a2c3-f895-458e-a0e4-b59a86b99c3c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:02:02.247030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-4507a2c3-f895-458e-a0e4-b59a86b99c3c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for user 2b64b05230b940eba992a063ea7cd778 and project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:02:02.273077 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4507a2c3-f895-458e-a0e4-b59a86b99c3c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052720 Aug 07 11:02:02.280222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 458/911] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 11:02:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:02.297410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lazy-loading 'services' on Instance uuid 71bde61e-a4b4-4a6c-87dc-23390b24133c {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:02:02.380455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-af403b8c-6e05-4ae6-9ec5-feb63669b990 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments/0d9a00ee-17f1-4b9f-b89e-22571da59c98" status: 202 len: 0 microversion: 2.1 time: 0.207134 Aug 07 11:02:02.386324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 454/912] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:02:02 2022] DELETE /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments/0d9a00ee-17f1-4b9f-b89e-22571da59c98 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:02:02.393283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:02.396370 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:02.405829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:02.406556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:02.407221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:02.413190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:02.413884 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:02.414473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:02.452777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3a8199c5-9e0e-40a9-b2e1-297cdd92bdcc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064117 Aug 07 11:02:02.453646 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 459/913] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:02:02 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:03.150186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:03.151000 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: edf03e0d-d4df-471c-a17e-db0ab8dbbc1f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:03.158287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:03.158774 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:03.159232 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:03.159994 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:03.160628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:03.161048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:03.180333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] HTTP exception thrown: Instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f could not be found. Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Request method failure captured: Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f HTTP/1.1 Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nVmZDqBLrDKaFPcpgAj1m59o29KiJgkU6QeMiRKYvuG9-HKcbDZxNkXe76Ofs3N4KQZo7-rYjxd-AAuB1e9uveaUp_uErWexkSZnBV-MiPM-RB2A0a0n43oyr-LtZIoAqjTuEE7K1-qP7s_rvHIN5ja6d9GrzIlpu9G6EPnUpBEd4 Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:02:03.182811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6ca365836428198f2d20fd9829feb", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: c3a12c3144844d32812e010550bb0921 Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f could not be found. Aug 07 11:02:03.184968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': 'edf03e0d-d4df-471c-a17e-db0ab8dbbc1f'} Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f could not be found. Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:02:03.186360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f could not be found. Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f could not be found. Aug 07 11:02:03.187620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:02:03.191802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Returning 404 to user: Instance edf03e0d-d4df-471c-a17e-db0ab8dbbc1f could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:02:03.191802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2658610b-d1e3-4277-b45c-6cadc1ec69cf tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f" status: 404 len: 111 microversion: 2.1 time: 0.038543 Aug 07 11:02:03.191802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 455/914] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:03 2022] GET /compute/v2.1/servers/edf03e0d-d4df-471c-a17e-db0ab8dbbc1f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:02:03.193203 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-02d74595-2181-40f1-9e6d-93839c633971 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '.version_select at 0x7fc5ed7719d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:03.216063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-02d74595-2181-40f1-9e6d-93839c633971 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1305991211" status: 202 len: 0 microversion: 2.1 time: 0.026647 Aug 07 11:02:03.216873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 460/915] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Aug 7 11:02:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1305991211 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:02:03.467909 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:03.470518 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:03.479367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:03.480846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:03.481487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:03.482837 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:03.483828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:03.484509 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:03.519750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f271111-fd8a-4aba-93a8-cdab545558a1 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057076 Aug 07 11:02:03.523045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 456/916] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:02:03 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:03.910601 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-764803517", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0162d8c1-679d-4577-b6e5-f73e9ca72395"}], "security_groups": [{"name": "tempest-securitygroup--1513568357"}], "key_name": "tempest-keypair-1464950634", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:04.025939 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] validate_networks() for [('0162d8c1-679d-4577-b6e5-f73e9ca72395', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:02:04.409349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:02:04.410132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:02:04.411052 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:02:04.411815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:02:04.412607 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:02:04.424151 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.424649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.425090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.425822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.426282 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.426709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.445561 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:02:04.450349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Getting quotas for user 2b64b05230b940eba992a063ea7cd778 and project 3c3be73ff916420f8c9eb418ef5f6716. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:02:04.461248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:02:04.463558 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:02:04.510409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3e3c4063-2a65-4abb-8078-874986edd760 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604639 Aug 07 11:02:04.511725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 461/917] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:02:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 11:02:04.522395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c5cd8946-e798-40a8-beed-e17d064c3609 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:04.523105 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c5cd8946-e798-40a8-beed-e17d064c3609 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:04.533465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:04.536006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:04.537903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:04.543381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.543859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.544320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.545019 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.545466 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.545886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.577958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-943b3f9a-a363-4f92-877a-6fce53874f76 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048547 Aug 07 11:02:04.583828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 462/918] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:02:04 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 11:02:04.602408 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c5cd8946-e798-40a8-beed-e17d064c3609 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:04.611130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c5cd8946-e798-40a8-beed-e17d064c3609 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1237 microversion: 2.1 time: 0.092227 Aug 07 11:02:04.612092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 457/919] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:04 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:04.641713 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:04.642276 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:04.648464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.648942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.649371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.650058 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.650514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.650945 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.676529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:02:04.754495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-32e08006-1326-4ff6-9a77-3045c840e869 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 204 len: 0 microversion: 2.1 time: 0.116342 Aug 07 11:02:04.755242 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 463/920] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:02:04 2022] DELETE /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:02:04.770731 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:04.771385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:04.778476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.778986 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.779779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.780154 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:04.780606 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:04.781029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:04.922572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:04.930947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a0beba48-42b5-43c5-bcd9-e6491d271dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1682 microversion: 2.1 time: 0.171359 Aug 07 11:02:04.931543 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 458/921] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:04 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:05.633007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:05.633706 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:05.640090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:05.640571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:05.641001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:05.641684 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:05.642136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:05.642557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:05.708462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:05.717277 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d28a263-5975-4568-a10b-2c3c71854196 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1233 microversion: 2.1 time: 0.088449 Aug 07 11:02:05.717960 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 464/922] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:05 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:05.952338 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:05.952910 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:05.959332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:05.959814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:05.960247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:05.960935 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:05.961393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:05.961819 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:06.091324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:06.098817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4b7ca3a1-998e-46fb-81b6-82b96b259f44 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1682 microversion: 2.1 time: 0.151172 Aug 07 11:02:06.099412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 459/923] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:05 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:06.165145 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:06.165648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:06.172180 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:06.172697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:06.173132 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:06.173826 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:06.174288 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:06.174714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:06.200205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:02:06.281822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5782a0e0-8080-4b5b-84fc-9369ba219934 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 204 len: 0 microversion: 2.1 time: 0.120149 Aug 07 11:02:06.285597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 465/924] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:02:06 2022] DELETE /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:02:06.291984 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:06.292813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:06.299400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:06.299893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:06.300331 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:06.301025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:06.301484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:06.301909 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:06.434310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:06.441940 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ec2c9a20-4127-449f-812d-877a4718d960 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1506 microversion: 2.1 time: 0.154356 Aug 07 11:02:06.442505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 460/925] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:06 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:06.739728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:06.740459 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:06.746491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:06.747007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:06.747449 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:06.748149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:06.748606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:06.749030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:06.819369 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:06.827387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-46849182-172a-4480-a025-028359a457dd tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1295 microversion: 2.1 time: 0.092118 Aug 07 11:02:06.827961 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 466/926] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:06 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:07.120266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:07.121857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:07.127798 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:07.128280 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:07.128710 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:07.129397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:07.129847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:07.130525 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:07.294437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:07.302704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-072eb7ca-c465-4f5f-91a4-cf7d4cbde468 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1682 microversion: 2.1 time: 0.186281 Aug 07 11:02:07.303289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 461/927] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:07 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:07.467800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:07.468747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:07.476849 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:07.477332 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:07.477770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:07.478506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:07.479190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:07.480771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:07.686064 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:07.695827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-11d89fea-d4e8-41c2-800e-35f9009cd37b tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1506 microversion: 2.1 time: 0.234267 Aug 07 11:02:07.697030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 467/928] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:07 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:07.837297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-d08106ac-f9ae-4ea5-9d8d-9b961d664051 req-7c88ac1d-ca42-4f38-83f6-fb12c1fbf309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bde61e-a4b4-4a6c-87dc-23390b24133c", "name": "network-vif-deleted", "tag": "608cc7ba-ed02-42a5-80dd-933bc7090500"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:07.850784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:07.851446 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:07.868168 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:07.868948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:07.869565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:07.871100 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:07.873517 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:07.874480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:07.900717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d08106ac-f9ae-4ea5-9d8d-9b961d664051 req-7c88ac1d-ca42-4f38-83f6-fb12c1fbf309 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:07.901318 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d08106ac-f9ae-4ea5-9d8d-9b961d664051 req-7c88ac1d-ca42-4f38-83f6-fb12c1fbf309 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:07.901991 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d08106ac-f9ae-4ea5-9d8d-9b961d664051 req-7c88ac1d-ca42-4f38-83f6-fb12c1fbf309 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:07.935147 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-d08106ac-f9ae-4ea5-9d8d-9b961d664051 req-7c88ac1d-ca42-4f38-83f6-fb12c1fbf309 service nova] Creating event network-vif-deleted:608cc7ba-ed02-42a5-80dd-933bc7090500 for instance 71bde61e-a4b4-4a6c-87dc-23390b24133c on hv-cinder-85032 Aug 07 11:02:07.966333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-d08106ac-f9ae-4ea5-9d8d-9b961d664051 req-7c88ac1d-ca42-4f38-83f6-fb12c1fbf309 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145828 Aug 07 11:02:07.966967 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 462/929] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:08.082253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-916b9ba9-44c0-4cd4-9fd8-f5e276f8d071 req-a12ca557-e87d-4faf-87df-54038e1ff223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f67c015-509d-42e7-b1fb-0b70bdafefa9", "name": "network-vif-deleted", "tag": "0a235f8a-de93-40e4-8382-67cb77a1c7e4"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:08.099703 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-916b9ba9-44c0-4cd4-9fd8-f5e276f8d071 req-a12ca557-e87d-4faf-87df-54038e1ff223 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:08.100187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-916b9ba9-44c0-4cd4-9fd8-f5e276f8d071 req-a12ca557-e87d-4faf-87df-54038e1ff223 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:08.100624 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-916b9ba9-44c0-4cd4-9fd8-f5e276f8d071 req-a12ca557-e87d-4faf-87df-54038e1ff223 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:08.145570 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-916b9ba9-44c0-4cd4-9fd8-f5e276f8d071 req-a12ca557-e87d-4faf-87df-54038e1ff223 service nova] Creating event network-vif-deleted:0a235f8a-de93-40e4-8382-67cb77a1c7e4 for instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 on hv-cinder-85032 Aug 07 11:02:08.150669 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-916b9ba9-44c0-4cd4-9fd8-f5e276f8d071 req-a12ca557-e87d-4faf-87df-54038e1ff223 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073001 Aug 07 11:02:08.152728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 463/930] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:02:08.196624 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:08.206605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26d82bdf-4b40-48a5-bc18-7cb94a89793d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1363 microversion: 2.1 time: 0.361294 Aug 07 11:02:08.207868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 468/931] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:07 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:02:08.326975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:08.327796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:08.334558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:08.335187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:08.335702 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:08.337301 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:08.337864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:08.338373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:08.427741 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:08.430266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:08.431014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:08.431995 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lazy-loading 'fault' on Instance uuid 71bde61e-a4b4-4a6c-87dc-23390b24133c {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:02:08.498269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:08.507037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cfbb04c3-a4fe-42b0-98af-25065414ff18 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 200 len: 1331 microversion: 2.1 time: 0.186483 Aug 07 11:02:08.521064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 464/932] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:08 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 1331 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:08.717834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:08.718681 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:08.724672 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:08.725390 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:08.725824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:08.726702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:08.727777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:08.728210 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:08.762041 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:08.762822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:08.763295 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:08.763750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lazy-loading 'fault' on Instance uuid 6f67c015-509d-42e7-b1fb-0b70bdafefa9 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:02:08.818634 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:08.827915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eb099303-8daf-4c93-a7b5-2aeec5f403f9 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 200 len: 1311 microversion: 2.1 time: 0.114285 Aug 07 11:02:08.830410 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 469/933] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:08 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:02:09.229675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:09.230882 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:09.237567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.238060 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.238531 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.239257 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.239716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.240144 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.378589 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:09.386477 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-84ab699e-14d4-421a-a4a8-2962620c6eb9 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1363 microversion: 2.1 time: 0.160922 Aug 07 11:02:09.387078 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 465/934] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:09 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:09.528843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:09.529529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:09.536048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.536540 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.536979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.537685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.538147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.538577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.541333 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:09.554792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c HTTP/1.1 Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:02:09.556807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:02:09.558569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '71bde61e-a4b4-4a6c-87dc-23390b24133c'} Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:02:09.560270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:02:09.561725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.563055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:02:09.563055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-aeeb24cd-c49d-49e4-95bd-b4d2256ad29b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 404 len: 111 microversion: 2.1 time: 0.033975 Aug 07 11:02:09.563055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 470/935] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:09 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:02:09.567248 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-102ecd86-1a9c-4200-a07f-13b6cc080f2c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '.version_select at 0x7fc5ed863430>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:09.587082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-102ecd86-1a9c-4200-a07f-13b6cc080f2c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941644687" status: 202 len: 0 microversion: 2.1 time: 0.023607 Aug 07 11:02:09.587672 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 466/936] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Aug 7 11:02:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941644687 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:02:09.851345 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:09.851958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: 6f67c015-509d-42e7-b1fb-0b70bdafefa9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:09.859802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.860284 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.860720 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.861500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.861858 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.862276 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.877062 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] HTTP exception thrown: Instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 could not be found. Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Request method failure captured: Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 HTTP/1.1 Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nVmZDqBLrDKaFPcpgAj1m59o29KiJgkU6QeMiRKYvuG9-HKcbDZxNkXe76Ofs3N4KQZo7-rYjxd-AAuB1e9uveaUp_uErWexkSZnBV-MiPM-RB2A0a0n43oyr-LtZIoAqjTuEE7K1-qP7s_rvHIN5ja6d9GrzIlpu9G6EPnUpBEd4 Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:02:09.878647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6ca365836428198f2d20fd9829feb", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c3a12c3144844d32812e010550bb0921 Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 could not be found. Aug 07 11:02:09.880361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '6f67c015-509d-42e7-b1fb-0b70bdafefa9'} Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 could not be found. Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:02:09.881470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 could not be found. Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 could not be found. Aug 07 11:02:09.882694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:09.884786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Returning 404 to user: Instance 6f67c015-509d-42e7-b1fb-0b70bdafefa9 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:02:09.884786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0f94a233-e5e9-4761-8e7a-4c3335baadad tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9" status: 404 len: 111 microversion: 2.1 time: 0.032640 Aug 07 11:02:09.884786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 471/937] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:09 2022] GET /compute/v2.1/servers/6f67c015-509d-42e7-b1fb-0b70bdafefa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:02:09.889022 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:09.889531 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:09.895498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.895987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.896428 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.897124 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:09.897614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:09.898044 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:09.924084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:02:10.006375 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-39147772-9396-4d29-8ec5-2687097b801a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 204 len: 0 microversion: 2.1 time: 0.121357 Aug 07 11:02:10.007584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 467/938] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:02:09 2022] DELETE /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:02:10.015662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:10.016311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:10.022499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:10.023134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:10.023639 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:10.024396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:10.024923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:10.025429 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:10.252803 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:10.260567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-aad958ff-84e1-4050-916c-dc55566c9bd5 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.248700 Aug 07 11:02:10.261271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 472/939] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:10 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:10.295368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-17b7caa0-e647-4a81-a99c-ef0ea3a3fdfd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: .version_select at 0x7fc5ed776820>, body: {"keypair": {"name": "tempest-keypair-1552713837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbdFmx3bOXXSAjSo99Dk3ficqYWup3HxFbB6X0fgG5WSHBnfWLYbeIXzjG53XrTvAUvhV0kwCuKduwYVXkkBs45jst2j0ufHS4pHeHjKfAjDNt6X8nheXKORu+lAgDxqw=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:10.311016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-17b7caa0-e647-4a81-a99c-ef0ea3a3fdfd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:02:10.314779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-17b7caa0-e647-4a81-a99c-ef0ea3a3fdfd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:02:10.323706 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:10.337767 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-17b7caa0-e647-4a81-a99c-ef0ea3a3fdfd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047421 Aug 07 11:02:10.338346 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 468/940] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 11:02:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:10.379437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-4f3c8bf4-1e5e-4cfb-b3be-bbb9f0fcc1cc req-e9438601-7714-4a74-b313-7b0f4ccee78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d231019-5516-4731-b4ca-91528de2a148", "tag": "3a58ac62-2cc4-4494-97d0-34b0b943dc9a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:10.389856 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4f3c8bf4-1e5e-4cfb-b3be-bbb9f0fcc1cc req-e9438601-7714-4a74-b313-7b0f4ccee78d service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:10.390338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4f3c8bf4-1e5e-4cfb-b3be-bbb9f0fcc1cc req-e9438601-7714-4a74-b313-7b0f4ccee78d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:10.390767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4f3c8bf4-1e5e-4cfb-b3be-bbb9f0fcc1cc req-e9438601-7714-4a74-b313-7b0f4ccee78d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:10.402810 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-4f3c8bf4-1e5e-4cfb-b3be-bbb9f0fcc1cc req-e9438601-7714-4a74-b313-7b0f4ccee78d service nova] Creating event network-changed:3a58ac62-2cc4-4494-97d0-34b0b943dc9a for instance 2d231019-5516-4731-b4ca-91528de2a148 on hv-cinder-85032 Aug 07 11:02:10.408233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-4f3c8bf4-1e5e-4cfb-b3be-bbb9f0fcc1cc req-e9438601-7714-4a74-b313-7b0f4ccee78d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032407 Aug 07 11:02:10.408831 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 473/941] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:10.409777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:10.411696 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:10.420501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:10.420768 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:10.421959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:10.423044 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:10.423752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:10.424266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:10.444553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:10.596700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:10.604115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b116b73e-44b4-4c2e-8819-a1471a79e73f tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1363 microversion: 2.1 time: 0.199994 Aug 07 11:02:10.604958 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 469/942] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:10 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:11.282966 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:11.283671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:11.289881 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:11.290376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:11.290839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:11.291546 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:11.292002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:11.293056 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:11.431960 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:11.440368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07b2873d-e9c6-4f7a-8231-9d88d0c60923 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.162387 Aug 07 11:02:11.440941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 474/943] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:11 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:11.624318 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:11.624929 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:11.632677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:11.633163 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:11.633622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:11.634551 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:11.634833 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:11.635278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:11.639909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1053529223", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a58cdcc4-38d5-4381-93af-404135fb0ce7"}], "security_groups": [{"name": "tempest-securitygroup--898031814"}], "key_name": "tempest-keypair-1552713837", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:11.782620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] validate_networks() for [('a58cdcc4-38d5-4381-93af-404135fb0ce7', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:02:11.864897 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:11.877620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-84416dde-579c-4a6a-96df-642de145aee8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1363 microversion: 2.1 time: 0.256177 Aug 07 11:02:11.891965 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 470/944] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:11 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:12.191424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:02:12.191850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:02:12.192318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:02:12.192721 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:02:12.193129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:02:12.203446 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:12.203925 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:12.204354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:12.205071 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:12.205519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:12.205938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:12.223110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:02:12.227097 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:02:12.238823 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:02:12.241105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:02:12.286229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8dc0d215-fd6c-4695-aefb-ea49f10501ac tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.650399 Aug 07 11:02:12.287252 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 475/945] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:02:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 11:02:12.298233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-280ead98-124f-462e-aec2-4699f28c36e2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:12.298889 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-280ead98-124f-462e-aec2-4699f28c36e2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:12.358842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-280ead98-124f-462e-aec2-4699f28c36e2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:12.371617 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-280ead98-124f-462e-aec2-4699f28c36e2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1242 microversion: 2.1 time: 0.077065 Aug 07 11:02:12.372468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 471/946] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:12 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:02:12.461040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:12.461649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:12.468903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:12.469392 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:12.469825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:12.470833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:12.471704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:12.472469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:12.708883 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:12.717070 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7caef03a-e1e3-4d5c-bda8-1c449811d2e0 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1520 microversion: 2.1 time: 0.259905 Aug 07 11:02:12.717705 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 476/947] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:12 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:12.902002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:12.902782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:12.909293 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:12.909909 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:12.910448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:12.911282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:12.911864 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:12.912388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.146751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:13.155724 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-96b553e8-362c-4a56-a2f5-1db2cf77b81c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1363 microversion: 2.1 time: 0.257761 Aug 07 11:02:13.156353 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 472/948] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:12 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:13.159023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-612662cf-cb2b-4e1e-8b91-f437dd80c3c6 req-fd046b76-49e8-4b07-a7a8-05b2f19feb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e465ec9d-f167-4410-b5dd-95c885e888a4", "name": "network-vif-deleted", "tag": "fe5bcaad-6e9a-4fc9-a938-a0811d665192"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:13.169396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-612662cf-cb2b-4e1e-8b91-f437dd80c3c6 req-fd046b76-49e8-4b07-a7a8-05b2f19feb93 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:13.169874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-612662cf-cb2b-4e1e-8b91-f437dd80c3c6 req-fd046b76-49e8-4b07-a7a8-05b2f19feb93 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:13.170308 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-612662cf-cb2b-4e1e-8b91-f437dd80c3c6 req-fd046b76-49e8-4b07-a7a8-05b2f19feb93 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.180892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-612662cf-cb2b-4e1e-8b91-f437dd80c3c6 req-fd046b76-49e8-4b07-a7a8-05b2f19feb93 service nova] Creating event network-vif-deleted:fe5bcaad-6e9a-4fc9-a938-a0811d665192 for instance e465ec9d-f167-4410-b5dd-95c885e888a4 on hv-cinder-85032 Aug 07 11:02:13.185991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-612662cf-cb2b-4e1e-8b91-f437dd80c3c6 req-fd046b76-49e8-4b07-a7a8-05b2f19feb93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030598 Aug 07 11:02:13.186562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 477/949] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:02:13.392722 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:13.393356 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:13.399373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:13.400224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:13.401048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.402481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:13.403121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:13.403698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.487343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:13.497069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-35719cdd-415f-4681-8c4d-0b4cddc5f008 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1302 microversion: 2.1 time: 0.108275 Aug 07 11:02:13.498340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 473/950] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:13 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:13.738690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:13.739418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:13.747709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:13.748202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:13.748859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.749347 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:13.749803 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:13.750427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.782872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:13.783386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:13.783819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.784262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lazy-loading 'fault' on Instance uuid e465ec9d-f167-4410-b5dd-95c885e888a4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:02:13.851834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a12c3144844d32812e010550bb0921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df6ca365836428198f2d20fd9829feb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:13.858962 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-b7e1533e-cff1-4237-bed8-738dbe786449 req-f27ec850-52be-4bed-a8e9-8607f18a448f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d231019-5516-4731-b4ca-91528de2a148", "name": "network-vif-plugged", "status": "completed", "tag": "3a58ac62-2cc4-4494-97d0-34b0b943dc9a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:13.862405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7740bf64-a6c9-4caa-8f43-f9c7b181187a tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 200 len: 1311 microversion: 2.1 time: 0.127482 Aug 07 11:02:13.863128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 478/951] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:13 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:13.871776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b7e1533e-cff1-4237-bed8-738dbe786449 req-f27ec850-52be-4bed-a8e9-8607f18a448f service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:13.872394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b7e1533e-cff1-4237-bed8-738dbe786449 req-f27ec850-52be-4bed-a8e9-8607f18a448f service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:13.873041 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b7e1533e-cff1-4237-bed8-738dbe786449 req-f27ec850-52be-4bed-a8e9-8607f18a448f service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:13.886803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-b7e1533e-cff1-4237-bed8-738dbe786449 req-f27ec850-52be-4bed-a8e9-8607f18a448f service nova] Creating event network-vif-plugged:3a58ac62-2cc4-4494-97d0-34b0b943dc9a for instance 2d231019-5516-4731-b4ca-91528de2a148 on hv-cinder-85032 Aug 07 11:02:13.892072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-b7e1533e-cff1-4237-bed8-738dbe786449 req-f27ec850-52be-4bed-a8e9-8607f18a448f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037809 Aug 07 11:02:13.893139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 474/952] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:02:14.176092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:14.176712 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:14.183569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:14.184060 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:14.184557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:14.185272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:14.185737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:14.186170 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:14.381026 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:14.390065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5f64500e-6b42-4aee-a308-95a3627d8674 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1363 microversion: 2.1 time: 0.217685 Aug 07 11:02:14.390692 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 479/953] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:14 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:14.522316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:14.523509 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:14.530627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:14.531210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:14.532288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:14.532996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:14.533453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:14.533903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:14.884363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:14.885131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] [instance: e465ec9d-f167-4410-b5dd-95c885e888a4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:14.893232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:14.893805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:14.894311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:14.895112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:14.895581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:14.896005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:14.911913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] HTTP exception thrown: Instance e465ec9d-f167-4410-b5dd-95c885e888a4 could not be found. Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Request method failure captured: Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 HTTP/1.1 Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nVmZDqBLrDKaFPcpgAj1m59o29KiJgkU6QeMiRKYvuG9-HKcbDZxNkXe76Ofs3N4KQZo7-rYjxd-AAuB1e9uveaUp_uErWexkSZnBV-MiPM-RB2A0a0n43oyr-LtZIoAqjTuEE7K1-qP7s_rvHIN5ja6d9GrzIlpu9G6EPnUpBEd4 Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:02:14.913668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9df6ca365836428198f2d20fd9829feb", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9df6ca365836428198f2d20fd9829feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 9df6ca365836428198f2d20fd9829feb Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1349914051 Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c3a12c3144844d32812e010550bb0921 Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1349914051-project Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance e465ec9d-f167-4410-b5dd-95c885e888a4 could not be found. Aug 07 11:02:14.915278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': 'e465ec9d-f167-4410-b5dd-95c885e888a4'} Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e465ec9d-f167-4410-b5dd-95c885e888a4 could not be found. Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:02:14.916161 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e465ec9d-f167-4410-b5dd-95c885e888a4 could not be found. Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e465ec9d-f167-4410-b5dd-95c885e888a4 could not be found. Aug 07 11:02:14.918044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:02:14.919495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] Returning 404 to user: Instance e465ec9d-f167-4410-b5dd-95c885e888a4 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:02:14.919495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c10442b6-1761-4c4d-ad85-10e387e60417 tempest-ServerRescueNegativeTestJSON-1349914051 tempest-ServerRescueNegativeTestJSON-1349914051-project] 10.222.0.25 "GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4" status: 404 len: 111 microversion: 2.1 time: 0.036798 Aug 07 11:02:14.919495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 480/954] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:14 2022] GET /compute/v2.1/servers/e465ec9d-f167-4410-b5dd-95c885e888a4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:02:14.975057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:14.983846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9103f4f6-a885-4e49-8f96-17594a0fce36 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.468810 Aug 07 11:02:14.984505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 475/955] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:14 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:02:15.411285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:15.412211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:15.418739 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:15.419272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:15.419715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:15.420435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:15.420900 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:15.421321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:15.626186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:15.633930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bc56a071-5382-41a2-b11d-8cb4b63b0e4c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1363 microversion: 2.1 time: 0.226766 Aug 07 11:02:15.634647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 481/956] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:15 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:15.832227 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-18d04916-3213-4bf1-8773-630e9897d1f0 req-bb6ddc1f-6ed4-4770-b749-5d158cef8ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ce0c19-1f84-4341-926f-d60fb8e0273b", "tag": "e9f7ef6f-cb8e-41bd-a1ae-524778411cae"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:15.843752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-18d04916-3213-4bf1-8773-630e9897d1f0 req-bb6ddc1f-6ed4-4770-b749-5d158cef8ddb service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:15.844475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-18d04916-3213-4bf1-8773-630e9897d1f0 req-bb6ddc1f-6ed4-4770-b749-5d158cef8ddb service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:15.845063 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-18d04916-3213-4bf1-8773-630e9897d1f0 req-bb6ddc1f-6ed4-4770-b749-5d158cef8ddb service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:15.858661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-18d04916-3213-4bf1-8773-630e9897d1f0 req-bb6ddc1f-6ed4-4770-b749-5d158cef8ddb service nova] Creating event network-changed:e9f7ef6f-cb8e-41bd-a1ae-524778411cae for instance 62ce0c19-1f84-4341-926f-d60fb8e0273b on hv-cinder-85032 Aug 07 11:02:15.864064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-18d04916-3213-4bf1-8773-630e9897d1f0 req-bb6ddc1f-6ed4-4770-b749-5d158cef8ddb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035763 Aug 07 11:02:15.864667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 476/957] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:16.005723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:16.006570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:16.013956 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:16.014389 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:16.014788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:16.015679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:16.016205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:16.016639 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:16.223090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:16.241523 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4c7e6262-d557-4dca-bc80-df4b89a22209 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.239636 Aug 07 11:02:16.242556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 482/958] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:16 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:16.656226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:16.657217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:16.663695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:16.664475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:16.665086 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:16.665960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:16.666575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:16.667769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:16.913615 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:16.924134 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5f13a70e-c5eb-45d6-87b7-494a0c743d36 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1549 microversion: 2.1 time: 0.272486 Aug 07 11:02:16.925551 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 477/959] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:16 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1549 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:16.946266 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:16.946758 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:16.953198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:16.953910 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:16.954496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:16.955502 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:16.956015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:16.956441 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:17.066291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-067b8474-5c72-4e78-a74a-91a82fb107db tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123259 Aug 07 11:02:17.068942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 483/960] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 11:02:16 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:17.266458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:17.267509 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:17.274903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:17.275435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:17.276027 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:17.276865 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:17.277385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:17.277747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:17.554978 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:17.565294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-85c0169d-f203-4306-a557-630774e663e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.306215 Aug 07 11:02:17.566596 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 478/961] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:17 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:18.196826 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-2bc38a4e-0236-40bf-9dd5-6a3d90c6537a req-2bbd1578-f14a-4909-b7b4-8741061b23fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d231019-5516-4731-b4ca-91528de2a148", "tag": "3a58ac62-2cc4-4494-97d0-34b0b943dc9a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:18.206911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2bc38a4e-0236-40bf-9dd5-6a3d90c6537a req-2bbd1578-f14a-4909-b7b4-8741061b23fb service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:18.207554 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2bc38a4e-0236-40bf-9dd5-6a3d90c6537a req-2bbd1578-f14a-4909-b7b4-8741061b23fb service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:18.208046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2bc38a4e-0236-40bf-9dd5-6a3d90c6537a req-2bbd1578-f14a-4909-b7b4-8741061b23fb service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:18.220023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-2bc38a4e-0236-40bf-9dd5-6a3d90c6537a req-2bbd1578-f14a-4909-b7b4-8741061b23fb service nova] Creating event network-changed:3a58ac62-2cc4-4494-97d0-34b0b943dc9a for instance 2d231019-5516-4731-b4ca-91528de2a148 on hv-cinder-85032 Aug 07 11:02:18.225547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-2bc38a4e-0236-40bf-9dd5-6a3d90c6537a req-2bbd1578-f14a-4909-b7b4-8741061b23fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033096 Aug 07 11:02:18.226228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 484/962] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:18.585651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:18.586800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:18.594476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:18.595257 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:18.596532 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:18.597427 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:18.598059 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:18.598680 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:18.761278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:18.771878 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3cc7c12d-febd-4bed-9b13-5da48b8f2615 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.189917 Aug 07 11:02:18.783445 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 479/963] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:18 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:19.795037 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:19.795732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:19.801927 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:19.802415 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:19.802844 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:19.803559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:19.804186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:19.804608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:19.955005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:19.962482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9ef18e3d-e487-4091-93b1-b2a4555a3dee tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.172702 Aug 07 11:02:19.963065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 485/964] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:19 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:20.984601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:20.985242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:20.991755 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:20.992235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:20.992670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:20.993348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:20.993800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:20.994219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:21.131298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:21.139519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e29c87f0-c1ab-4bf0-969f-6eef97580fec tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.159021 Aug 07 11:02:21.140089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 480/965] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:20 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:02:21.173407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5c9a202a-5d10-40e2-86bb-d06aa1e5a016 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed91c9d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:21.220554 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5c9a202a-5d10-40e2-86bb-d06aa1e5a016 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a3e68cd9-d2aa-4a1b-9fb6-82cc350e066c" status: 200 len: 350 microversion: 2.1 time: 0.050845 Aug 07 11:02:21.221250 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 486/966] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 11:02:21 2022] GET /compute/v2.1/os-volumes/a3e68cd9-d2aa-4a1b-9fb6-82cc350e066c => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:21.838810 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-d6f74f96-7a0a-45e8-b86c-48066c7f0318 req-e3534c4e-6891-4be0-9ef8-e94d1189ec1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ce0c19-1f84-4341-926f-d60fb8e0273b", "name": "network-vif-plugged", "status": "completed", "tag": "e9f7ef6f-cb8e-41bd-a1ae-524778411cae"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:21.850480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d6f74f96-7a0a-45e8-b86c-48066c7f0318 req-e3534c4e-6891-4be0-9ef8-e94d1189ec1c service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:21.850983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d6f74f96-7a0a-45e8-b86c-48066c7f0318 req-e3534c4e-6891-4be0-9ef8-e94d1189ec1c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:21.851604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d6f74f96-7a0a-45e8-b86c-48066c7f0318 req-e3534c4e-6891-4be0-9ef8-e94d1189ec1c service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:21.863932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-d6f74f96-7a0a-45e8-b86c-48066c7f0318 req-e3534c4e-6891-4be0-9ef8-e94d1189ec1c service nova] Creating event network-vif-plugged:e9f7ef6f-cb8e-41bd-a1ae-524778411cae for instance 62ce0c19-1f84-4341-926f-d60fb8e0273b on hv-cinder-85032 Aug 07 11:02:21.868860 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-d6f74f96-7a0a-45e8-b86c-48066c7f0318 req-e3534c4e-6891-4be0-9ef8-e94d1189ec1c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033824 Aug 07 11:02:21.869627 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 481/967] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:22.160253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:22.160964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:22.167606 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:22.168111 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:22.168541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:22.169230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:22.169677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:22.170095 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:22.214278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=4 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:22.234625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=16 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:22.299634 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:22.307140 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8057cbf1-115e-4ce7-b647-99287b513c92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.150934 Aug 07 11:02:22.307971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 487/968] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:22 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:22.550568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b92b1273-0559-42f5-996a-0424bad81817 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed863430>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:22.557523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=8 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:22.600051 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b92b1273-0559-42f5-996a-0424bad81817 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/748cf13a-7a3e-4d36-889d-3e8a5a308769" status: 200 len: 351 microversion: 2.1 time: 0.053497 Aug 07 11:02:22.600644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 482/969] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 11:02:22 2022] GET /compute/v2.1/os-volumes/748cf13a-7a3e-4d36-889d-3e8a5a308769 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:23.327571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:23.328186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:23.334710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:23.335241 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:23.335679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:23.336379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:23.336867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:23.337296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:23.469736 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:23.477127 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-635840e0-d274-486b-b34c-1134898722e8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1367 microversion: 2.1 time: 0.153500 Aug 07 11:02:23.477685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 488/970] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:23 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:23.928966 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e2253db0-b299-4cb3-8cc5-a01525ee4bb8 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed9a64c0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:23.976459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e2253db0-b299-4cb3-8cc5-a01525ee4bb8 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6df4fb3b-ff84-463a-a0f6-29bcaaffb48d" status: 200 len: 351 microversion: 2.1 time: 0.051650 Aug 07 11:02:23.977025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 483/971] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 11:02:23 2022] GET /compute/v2.1/os-volumes/6df4fb3b-ff84-463a-a0f6-29bcaaffb48d => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:23.990037 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7201351d-ddcc-49ee-b649-1d7ca5715118 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5edb12b80>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.072757 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7201351d-ddcc-49ee-b649-1d7ca5715118 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086450 Aug 07 11:02:24.073488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 489/972] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Aug 7 11:02:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:24.087649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0c7997d8-7625-48bb-b73a-bc892867b191 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed9da160>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.168799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0c7997d8-7625-48bb-b73a-bc892867b191 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084842 Aug 07 11:02:24.169378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 484/973] 10.222.0.25 () {58 vars in 1149 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:24.182340 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7e680ef3-bbb3-48db-acdc-1b571dbcae9a tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed91cc10>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.264233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7e680ef3-bbb3-48db-acdc-1b571dbcae9a tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085597 Aug 07 11:02:24.264825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 490/974] 10.222.0.25 () {58 vars in 1134 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:24.277883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d547a162-96c9-490a-9df7-80a2f942ace3 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed8330d0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.360750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d547a162-96c9-490a-9df7-80a2f942ace3 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087286 Aug 07 11:02:24.361320 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 485/975] 10.222.0.25 () {58 vars in 1167 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:24.375797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6b9e64e5-0bf2-4890-b17e-4ebbb697cdef tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5edb11160>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.465773 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6b9e64e5-0bf2-4890-b17e-4ebbb697cdef tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.095353 Aug 07 11:02:24.466342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 491/976] 10.222.0.25 () {58 vars in 1170 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:24.479454 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-243cac13-86f1-4ed8-bd7d-4e1ac7e4adc2 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed915ca0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.501368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.502054 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:24.508763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:24.509416 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:24.510046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:24.510788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:24.511267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:24.512524 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:24.567086 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-243cac13-86f1-4ed8-bd7d-4e1ac7e4adc2 tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090990 Aug 07 11:02:24.576663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 486/977] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:24.582370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-07bfd3dc-0c21-42b3-8436-74b4db42378f tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed94f9d0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.665187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-07bfd3dc-0c21-42b3-8436-74b4db42378f tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086582 Aug 07 11:02:24.665756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 487/978] 10.222.0.25 () {58 vars in 1188 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:24.678827 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c5d873f9-8501-4980-bc4a-de3cd412b05b tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] Calling method '.version_select at 0x7fc5ed94f430>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.721102 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:02:24.728982 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c5fff843-44d7-43d8-a0ce-70063c968060 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1557 microversion: 2.1 time: 0.233247 Aug 07 11:02:24.729532 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 492/979] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:02:24.751860 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:02:24.752859 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:02:24.759399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:24.759890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:24.760162 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c5d873f9-8501-4980-bc4a-de3cd412b05b tempest-VolumesTestJSON-148696773 tempest-VolumesTestJSON-148696773-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084950 Aug 07 11:02:24.760322 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:24.760767 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 488/980] 10.222.0.25 () {58 vars in 1155 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:02:24.762399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:24.762874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:24.763326 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:24.902489 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-239fa40d-9b06-47f7-8ca8-0644f85b3cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156197 Aug 07 11:02:24.903206 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 493/981] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 11:02:24 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:02:25.832422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-9e20197e-ace1-4aaf-90e0-627caa470bd9 req-8b5fcbc5-9ac8-44c1-a746-6fb4d6781bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ce0c19-1f84-4341-926f-d60fb8e0273b", "tag": "e9f7ef6f-cb8e-41bd-a1ae-524778411cae"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:02:25.842477 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-9e20197e-ace1-4aaf-90e0-627caa470bd9 req-8b5fcbc5-9ac8-44c1-a746-6fb4d6781bfa service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:02:25.842981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-9e20197e-ace1-4aaf-90e0-627caa470bd9 req-8b5fcbc5-9ac8-44c1-a746-6fb4d6781bfa service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:02:25.843411 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-9e20197e-ace1-4aaf-90e0-627caa470bd9 req-8b5fcbc5-9ac8-44c1-a746-6fb4d6781bfa service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:02:25.853587 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-9e20197e-ace1-4aaf-90e0-627caa470bd9 req-8b5fcbc5-9ac8-44c1-a746-6fb4d6781bfa service nova] Creating event network-changed:e9f7ef6f-cb8e-41bd-a1ae-524778411cae for instance 62ce0c19-1f84-4341-926f-d60fb8e0273b on hv-cinder-85032 Aug 07 11:02:25.858795 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-9e20197e-ace1-4aaf-90e0-627caa470bd9 req-8b5fcbc5-9ac8-44c1-a746-6fb4d6781bfa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030314 Aug 07 11:02:25.859438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 489/982] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:02:37.210515 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:02:37.211070 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:03:04.723955 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:04.724816 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=89 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:04.727255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:04.728314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=58 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:04.729091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:04.729847 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:04.734459 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-c3fc542a-4461-4441-bf74-c2afb8771216 req-ff5e8a0b-e2aa-4fc5-9ff2-4efe2110c1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223548c0-1e24-46fc-8238-56a431aadfd0", "tag": "2d0a513b-66b5-4ab9-9279-4055a67679fb"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:03:04.737316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:04.737912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:04.738445 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:04.739293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:04.739852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:04.740373 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:04.746557 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c3fc542a-4461-4441-bf74-c2afb8771216 req-ff5e8a0b-e2aa-4fc5-9ff2-4efe2110c1b3 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:04.746557 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c3fc542a-4461-4441-bf74-c2afb8771216 req-ff5e8a0b-e2aa-4fc5-9ff2-4efe2110c1b3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:04.746557 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c3fc542a-4461-4441-bf74-c2afb8771216 req-ff5e8a0b-e2aa-4fc5-9ff2-4efe2110c1b3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:04.758916 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-c3fc542a-4461-4441-bf74-c2afb8771216 req-ff5e8a0b-e2aa-4fc5-9ff2-4efe2110c1b3 service nova] Creating event network-changed:2d0a513b-66b5-4ab9-9279-4055a67679fb for instance 223548c0-1e24-46fc-8238-56a431aadfd0 on hv-cinder-85032 Aug 07 11:03:04.765388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-c3fc542a-4461-4441-bf74-c2afb8771216 req-ff5e8a0b-e2aa-4fc5-9ff2-4efe2110c1b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040418 Aug 07 11:03:04.766182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 490/983] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:03:04.767940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:03:04.857012 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d5862c5e-dab6-436f-8a15-7604cdc3bd83 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "DELETE /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 204 len: 0 microversion: 2.1 time: 0.134378 Aug 07 11:03:04.858941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 494/984] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:03:04 2022] DELETE /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:03:04.869553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:04.870310 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:04.878152 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:04.878634 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:04.879097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:04.882883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:04.882883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:04.882883 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:05.038733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:05.047339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b941ac22-854f-4f2f-8266-b6a54e688d88 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.182504 Aug 07 11:03:05.048100 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 491/985] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:04 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:03:06.070478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:06.071202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:06.078176 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:06.078662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:06.079120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:06.079821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:06.080274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:06.080694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:06.524075 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:06.532331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-88112dd5-3144-4f31-bd80-1c540398138d tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1570 microversion: 2.1 time: 0.466263 Aug 07 11:03:06.534577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 495/986] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:06 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1570 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:03:07.560749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:07.561444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:07.567988 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:07.568454 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:07.568885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:07.569580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:07.570036 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:07.570456 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:07.615079 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-050c9401-5aa6-4eec-a372-d122bfddbf04 req-a3aff4f6-4ce5-4955-9acc-003f202fd48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223548c0-1e24-46fc-8238-56a431aadfd0", "name": "network-vif-deleted", "tag": "2d0a513b-66b5-4ab9-9279-4055a67679fb"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:03:07.628600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-050c9401-5aa6-4eec-a372-d122bfddbf04 req-a3aff4f6-4ce5-4955-9acc-003f202fd48a service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:07.629156 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-050c9401-5aa6-4eec-a372-d122bfddbf04 req-a3aff4f6-4ce5-4955-9acc-003f202fd48a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:07.629604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-050c9401-5aa6-4eec-a372-d122bfddbf04 req-a3aff4f6-4ce5-4955-9acc-003f202fd48a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:07.645171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:07.649169 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-050c9401-5aa6-4eec-a372-d122bfddbf04 req-a3aff4f6-4ce5-4955-9acc-003f202fd48a service nova] Creating event network-vif-deleted:2d0a513b-66b5-4ab9-9279-4055a67679fb for instance 223548c0-1e24-46fc-8238-56a431aadfd0 on hv-cinder-85032 Aug 07 11:03:07.655522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-050c9401-5aa6-4eec-a372-d122bfddbf04 req-a3aff4f6-4ce5-4955-9acc-003f202fd48a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048365 Aug 07 11:03:07.657306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 496/987] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:03:07.657471 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bccf97a0-ab6c-4928-9fdb-412bc19e9c29 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1383 microversion: 2.1 time: 0.105606 Aug 07 11:03:07.658301 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 492/988] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:07 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1383 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:03:08.679766 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:08.680387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:08.687155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:08.687644 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:08.688082 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:08.688776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:08.689236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:08.689663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:08.721577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:08.722053 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:08.722483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:08.722947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lazy-loading 'fault' on Instance uuid 223548c0-1e24-46fc-8238-56a431aadfd0 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:03:08.764094 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:08.771565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-00c8e683-0ba2-475c-b8e9-e016b7b6cbb2 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1224 microversion: 2.1 time: 0.096654 Aug 07 11:03:08.772130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 497/989] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:08 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:03:09.509748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:09.510268 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:09.517237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:09.517716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:09.518148 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:09.518833 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:09.519312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:09.519729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:09.542158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3d47a698-8b67-481d-8300-188adc4ae1f2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/ips" status: 200 len: 151 microversion: 2.20 time: 0.036351 Aug 07 11:03:09.542725 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 493/990] 10.222.0.25 () {60 vars in 1289 bytes} [Sun Aug 7 11:03:09 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 11:03:09.793537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:09.794153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:09.801327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:09.801844 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:09.802285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:09.803011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:09.803957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:09.804389 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:09.840133 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:09.840616 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:09.841050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:09.841579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lazy-loading 'fault' on Instance uuid 223548c0-1e24-46fc-8238-56a431aadfd0 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:03:09.883109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:09.891327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f4e44cc0-16ac-4a1f-99fb-6f5bfd6602bc tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1224 microversion: 2.1 time: 0.101542 Aug 07 11:03:09.891894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 498/991] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:09 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:03:10.912717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:10.913330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:10.920351 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:10.921136 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:10.921601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:10.922296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:10.922750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:10.923202 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:10.955846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:10.956322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:10.956748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:10.957188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lazy-loading 'fault' on Instance uuid 223548c0-1e24-46fc-8238-56a431aadfd0 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:03:10.998413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:11.005708 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-51e54766-5947-4135-860a-02e2b25ebdf4 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1224 microversion: 2.1 time: 0.096936 Aug 07 11:03:11.006261 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 494/992] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:10 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:03:12.025709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:12.026423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:12.032979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:12.033455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:12.033887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:12.034579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:12.035068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:12.035655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:12.069247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:12.069735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:12.070180 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:12.070630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lazy-loading 'fault' on Instance uuid 223548c0-1e24-46fc-8238-56a431aadfd0 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:03:12.117937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb8ad1bff7f4e439cefdf6f0ef9a2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758665157bfd4f7fa6219f898a9c99a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:12.126315 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73818df3-489c-454c-bd12-f9fac655db34 tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 200 len: 1178 microversion: 2.1 time: 0.104575 Aug 07 11:03:12.127042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 499/993] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:12 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 1178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:03:13.146533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:13.147191 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] [instance: 223548c0-1e24-46fc-8238-56a431aadfd0] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:13.153529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:13.154693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:13.155290 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:13.156131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:13.156754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:13.157412 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:13.171555 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] HTTP exception thrown: Instance 223548c0-1e24-46fc-8238-56a431aadfd0 could not be found. Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Request method failure captured: Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 HTTP/1.1 Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75pWKpAYGbedWQb7CycV66Tt-XAOnjyFffthTCZy8VXeFKL61cNyAukf6lSq6NerzLNuZkLBaQjizOoSrlFNsvBAk7kzMJNd5qWlIPvlkRH2O7fT68QsDtOqPVrvffyllyjwyksYsyGv2PPTgOCxMBqeiu8MrHC97SeOMrWoeefox2g Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 758665157bfd4f7fa6219f898a9c99a2 Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestShelveInstance-902619692 Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:03:13.173246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/758665157bfd4f7fa6219f898a9c99a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_758665157bfd4f7fa6219f898a9c99a2", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/758665157bfd4f7fa6219f898a9c99a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/758665157bfd4f7fa6219f898a9c99a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestShelveInstance-902619692 Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 758665157bfd4f7fa6219f898a9c99a2 Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestShelveInstance-902619692 Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-TestShelveInstance-902619692-project Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 8cb8ad1bff7f4e439cefdf6f0ef9a2d0 Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestShelveInstance-902619692-project Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 223548c0-1e24-46fc-8238-56a431aadfd0 could not be found. Aug 07 11:03:13.174943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '223548c0-1e24-46fc-8238-56a431aadfd0'} Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223548c0-1e24-46fc-8238-56a431aadfd0 could not be found. Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:03:13.175968 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223548c0-1e24-46fc-8238-56a431aadfd0 could not be found. Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223548c0-1e24-46fc-8238-56a431aadfd0 could not be found. Aug 07 11:03:13.177511 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:03:13.178771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Returning 404 to user: Instance 223548c0-1e24-46fc-8238-56a431aadfd0 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:03:13.178771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2db7c4f2-2493-4e5b-9485-18345c3e330b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0" status: 404 len: 111 microversion: 2.1 time: 0.031952 Aug 07 11:03:13.178771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 495/994] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:03:13 2022] GET /compute/v2.1/servers/223548c0-1e24-46fc-8238-56a431aadfd0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:03:13.353563 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-001ea24b-62ae-4ded-ab21-dc63867c420b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] Calling method '.version_select at 0x7fc5ed980d30>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:13.385625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-001ea24b-62ae-4ded-ab21-dc63867c420b tempest-TestShelveInstance-902619692 tempest-TestShelveInstance-902619692-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1322765706" status: 202 len: 0 microversion: 2.1 time: 0.036909 Aug 07 11:03:13.386191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 500/995] 10.222.0.25 () {58 vars in 1254 bytes} [Sun Aug 7 11:03:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1322765706 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:03:13.437746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:03:13.438282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:13.446309 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:13.447016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:13.447465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:13.448160 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:13.448609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:13.449219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:13.475799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lazy-loading 'flavor' on Instance uuid 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:03:13.670591 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-82c39aa8-be6f-4e1b-b7ed-f3bd8f8c98cc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/action" status: 202 len: 0 microversion: 2.20 time: 0.237049 Aug 07 11:03:13.671418 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 496/996] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Aug 7 11:03:13 2022] POST /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:03:13.680263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:13.680821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:13.691464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:13.691971 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:13.692414 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:13.693134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:13.693597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:13.694025 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:13.913467 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:13.922316 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:13.924219 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:13.925381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5fc8d582-4555-4640-ba87-9f49df192e23 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.249491 Aug 07 11:03:13.925937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 501/997] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:13 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:14.949139 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:14.951838 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:14.957785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:14.958280 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:14.958717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:14.959553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:14.959905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:14.960601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:15.536305 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:15.553496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:15.555121 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:15.556552 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6c04117a-84cd-4c3c-9afd-e40a61a827ed tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.612504 Aug 07 11:03:15.557188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 497/998] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:14 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:16.581081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:16.581690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:16.588390 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:16.588876 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:16.589312 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:16.590020 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:16.590574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:16.591029 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:16.938607 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:16.949988 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:16.952380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:16.954678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bc7ca8be-c3b5-4f40-ba59-41acd07a4cac tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.377396 Aug 07 11:03:16.967374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 502/999] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:16 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:03:17.978721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:17.979274 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:17.986395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:17.987663 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:17.988340 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:17.989031 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:17.989549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:17.989975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:18.128458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:18.136447 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:18.138315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:18.139512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ad2b2271-f75c-4d3f-aa26-df2727c746ea tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.164758 Aug 07 11:03:18.140236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 498/1000] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:17 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:19.162611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:19.163468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:19.170604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:19.171360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:19.172052 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:19.173039 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:19.173573 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:19.174066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:19.308668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:19.318059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:19.319690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:19.320875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5a62dcc9-d196-420c-9c4e-72893454e664 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.162682 Aug 07 11:03:19.321895 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 503/1001] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:19 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:20.344783 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:20.345336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:20.351356 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:20.351844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:20.352278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:20.352980 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:20.353432 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:20.353856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:20.503272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:20.513157 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:20.515677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:20.517062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e9f808b8-3dc8-4329-81dc-d619d32cc105 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.176763 Aug 07 11:03:20.517690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 499/1002] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:20 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:21.541571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:21.542525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:21.551717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:21.552222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:21.552661 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:21.553465 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:21.553874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:21.554399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:21.692993 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:21.702774 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:21.704552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:21.705791 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-979de7cd-c7a3-42c1-bc78-971936bd2ac5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.169222 Aug 07 11:03:21.706379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 504/1003] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:21 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:22.729019 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:22.729541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:22.736776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:22.737258 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:22.737693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:22.738381 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:22.738839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:22.739285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:22.874038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:22.881885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:22.883448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:22.884611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f07e411-fa22-456b-be4c-a67d23a03a1a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.159609 Aug 07 11:03:22.885167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 500/1004] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:22 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:23.907336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:23.907850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:23.914202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:23.914679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:23.915150 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:23.915838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:23.916290 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:23.916710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:24.047594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:24.055589 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:24.057101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:24.058271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b4544c40-93b1-472a-b415-7c7059f1ad12 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.154992 Aug 07 11:03:24.058835 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 505/1005] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:23 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:25.081776 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:25.082369 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:25.088914 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:25.089399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:25.089836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:25.090528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:25.091559 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:25.092185 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:25.221278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:25.229247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:25.230739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:25.232595 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5edf4c49-9d7e-4985-9346-b5694746e2cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.154220 Aug 07 11:03:25.233295 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 501/1006] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:25 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:26.255731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:26.256468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:26.263733 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:26.264228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:26.264667 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:26.265368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:26.265827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:26.266255 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:26.398296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:26.406867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:26.408650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:26.409828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3e517b48-969e-407d-8b91-5e1023818f35 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.158023 Aug 07 11:03:26.410385 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 506/1007] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:26 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:27.432392 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:27.432992 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:27.440135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:27.440612 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:27.441038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:27.441714 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:27.442164 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:27.442581 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:27.574323 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:27.582713 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:27.584288 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:27.585439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7c5ec2ab-44e1-4c47-bbf8-9306cdc458b2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.156928 Aug 07 11:03:27.585983 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 502/1008] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:27 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:03:28.613304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:28.614063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:28.620774 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:28.621298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:28.621764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:28.623092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:28.623602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:28.624024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:28.763387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:28.771356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:28.772879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:28.774033 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bbc07a87-337d-448e-bcb4-fa83fb278ec1 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.168148 Aug 07 11:03:28.774594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 507/1009] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:28 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:29.800066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:29.801220 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:29.809569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:29.810089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:29.810662 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:29.811389 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:29.811845 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:29.812267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:29.967137 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:29.975594 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:29.977095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:29.978289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-50213ebe-a20c-4c7d-aafe-47a187775e5c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.184879 Aug 07 11:03:29.978996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 503/1010] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:29 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:31.002655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:31.003586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:31.010618 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:31.011131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:31.011570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:31.012270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:31.012795 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:31.013222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:31.149888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:31.158361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:31.159898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:31.161353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-84a916f6-8e6a-4dcb-8f17-22863a64e75a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.163604 Aug 07 11:03:31.161951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 508/1011] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:30 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:32.188302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:32.189278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:32.197523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:32.198242 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:32.199435 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:32.200945 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:32.202552 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:32.204465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:32.363554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:32.371777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:32.373896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:32.375291 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-30cc66e2-b73a-460a-a5a5-5944600fb483 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1743 microversion: 2.20 time: 0.194518 Aug 07 11:03:32.375850 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 504/1012] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:32 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:33.397644 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:33.398349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:33.405889 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:33.406422 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:33.406862 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:33.411325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:33.411325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:33.411325 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:33.428688 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:33.550721 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:33.559436 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:33.561342 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:33.562624 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b73d7756-200e-488f-93a9-97f64e528af4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1743 microversion: 2.20 time: 0.168951 Aug 07 11:03:33.563238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 509/1013] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:33 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:03:34.164004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-72eff70e-774f-45de-a1e7-6d7932e9eeba req-d695b5be-c595-4f6f-aa58-e65593023d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3", "name": "network-vif-plugged", "status": "completed", "tag": "1bfe5de2-026e-41d4-bd13-82bed6308b7d"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:03:34.177580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-72eff70e-774f-45de-a1e7-6d7932e9eeba req-d695b5be-c595-4f6f-aa58-e65593023d1a service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:34.178277 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-72eff70e-774f-45de-a1e7-6d7932e9eeba req-d695b5be-c595-4f6f-aa58-e65593023d1a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:34.178712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-72eff70e-774f-45de-a1e7-6d7932e9eeba req-d695b5be-c595-4f6f-aa58-e65593023d1a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:34.191339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-72eff70e-774f-45de-a1e7-6d7932e9eeba req-d695b5be-c595-4f6f-aa58-e65593023d1a service nova] Creating event network-vif-plugged:1bfe5de2-026e-41d4-bd13-82bed6308b7d for instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 on hv-cinder-85032 Aug 07 11:03:34.196516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-72eff70e-774f-45de-a1e7-6d7932e9eeba req-d695b5be-c595-4f6f-aa58-e65593023d1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036404 Aug 07 11:03:34.197481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 505/1014] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:03:34.585498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:34.586215 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:34.593205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:34.593788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:34.594292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:34.595031 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:34.595495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:34.595923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:34.731128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:34.739747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:34.741205 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:34.742413 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fb639f26-2b88-4622-8d7f-4917833c91dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1743 microversion: 2.20 time: 0.160815 Aug 07 11:03:34.743005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 510/1015] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:34 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:35.771025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:35.771025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:35.771025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=35 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:35.776665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:35.777154 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:35.777590 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:35.778498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:35.779062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:35.779492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:35.782334 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:35.925297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:35.933839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:35.936366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:35.937590 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e86d2e9f-037d-4826-97a3-b1e2b2c0a136 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1743 microversion: 2.20 time: 0.175647 Aug 07 11:03:35.938296 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 506/1016] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:35 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:36.960709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:36.961320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:36.963247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:36.969642 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:36.970135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:36.970561 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:36.971297 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:36.971753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:36.972175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:37.112840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:37.120799 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:37.122353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:37.123566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26b081b8-49eb-4f97-a53d-602e9f98070a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1743 microversion: 2.20 time: 0.166985 Aug 07 11:03:37.124137 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 511/1017] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:36 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:38.152737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:38.153681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:38.160606 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:38.161351 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:38.161953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:38.162668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:38.163168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:38.163754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:38.320753 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:38.330049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:38.331584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:38.332751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b3971d11-8caf-49da-9e64-d308514a2b08 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.185083 Aug 07 11:03:38.333531 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 507/1018] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:38 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:39.357314 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:39.358848 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:39.367129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:39.367890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:39.368533 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:39.370152 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:39.370613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:39.371062 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:39.544912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:39.553678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:39.555153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:39.556853 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8563ec15-bcb1-4fdf-9534-24f968bf2ef7 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.203802 Aug 07 11:03:39.558001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 512/1019] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:39 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:40.587146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:40.587742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:40.594942 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:40.595603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:40.596037 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:40.596740 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:40.597195 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:40.597611 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:40.743188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:40.752154 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:40.753661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:40.754895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cf4ec448-098b-434a-8917-0d10ceb6a426 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.171854 Aug 07 11:03:40.755666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 508/1020] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:40 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:41.782135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:41.783521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:41.790678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:41.791488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:41.792216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:41.793335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:41.794286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:41.795139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:41.947767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:41.956767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:41.958292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:41.959622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e5c9c01d-c69e-4a3a-87d4-2e69f2f571cf tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.182606 Aug 07 11:03:41.975057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 513/1021] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:41 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:42.983226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:42.984300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:42.991830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:42.993065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:42.994103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:42.995671 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:43.000953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:43.001979 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:43.203321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:43.218475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:43.220339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:43.222051 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8ff4cf1c-75b8-4386-9a29-096b0c82722e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.242937 Aug 07 11:03:43.222642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 509/1022] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:42 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:44.247065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:44.248469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:44.256155 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:44.257173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:44.258130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:44.259279 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:44.259965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:44.261349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:44.440677 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:44.454323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:44.457014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:44.459128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5ae38c80-d773-49e0-b8a5-272857de5520 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.217348 Aug 07 11:03:44.460796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 514/1023] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:44 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:45.486020 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:45.487396 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:45.494553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:45.495438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:45.496112 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:45.497110 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:45.497793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:45.498439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:45.714567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:45.723517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:45.726233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:45.727937 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ebce6464-34fe-49fd-942c-10fa009cde21 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.247486 Aug 07 11:03:45.743725 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 510/1024] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:45 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:46.752143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:46.752760 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:46.767837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:46.768620 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:46.769227 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:46.770122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:46.770754 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:46.771566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:46.947197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:46.956970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:46.958749 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:46.959979 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-489d6baa-6655-4334-8e01-1febe63e2f3f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1738 microversion: 2.20 time: 0.211703 Aug 07 11:03:46.961096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 515/1025] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:46 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:47.983952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:47.985199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:47.992250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:47.992746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:47.993187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:47.993900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:47.994358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:47.994785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:48.130754 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:48.141655 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:48.143957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:48.145532 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eb08f4bf-13c8-467d-bc1c-16f8a4a84a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1720 microversion: 2.20 time: 0.166086 Aug 07 11:03:48.146088 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 511/1026] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:47 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:49.170807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:49.171511 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:49.178582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:49.179109 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:49.179543 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:49.180236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:49.180684 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:49.181149 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:49.312629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:49.321293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:49.323046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:49.324327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-84d671ce-e7d0-4363-a3b9-03fa6768a79a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1720 microversion: 2.20 time: 0.158689 Aug 07 11:03:49.325525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 516/1027] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:49 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:03:50.220604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-0fed5261-637d-4617-8cd8-3c8dae827b67 req-a889c0dd-cb4a-4460-a2c3-ac260a6c4fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3", "name": "network-vif-unplugged", "status": "completed", "tag": "1bfe5de2-026e-41d4-bd13-82bed6308b7d"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:03:50.231932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0fed5261-637d-4617-8cd8-3c8dae827b67 req-a889c0dd-cb4a-4460-a2c3-ac260a6c4fc4 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:50.232628 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0fed5261-637d-4617-8cd8-3c8dae827b67 req-a889c0dd-cb4a-4460-a2c3-ac260a6c4fc4 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:50.233048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0fed5261-637d-4617-8cd8-3c8dae827b67 req-a889c0dd-cb4a-4460-a2c3-ac260a6c4fc4 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:50.245539 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-0fed5261-637d-4617-8cd8-3c8dae827b67 req-a889c0dd-cb4a-4460-a2c3-ac260a6c4fc4 service nova] Creating event network-vif-unplugged:1bfe5de2-026e-41d4-bd13-82bed6308b7d for instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 on hv-cinder-85032 Aug 07 11:03:50.251488 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-0fed5261-637d-4617-8cd8-3c8dae827b67 req-a889c0dd-cb4a-4460-a2c3-ac260a6c4fc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035105 Aug 07 11:03:50.252279 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 512/1028] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:03:50.347482 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:50.348127 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:50.354729 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:50.355267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:50.356258 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:50.357024 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:50.357429 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:50.357861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:50.513175 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:50.521478 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:50.523165 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:50.524339 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bc9a29ea-8590-4e11-873b-4846a80d5e4d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1720 microversion: 2.20 time: 0.180821 Aug 07 11:03:50.524901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 517/1029] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:50 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:51.549793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:51.550500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:51.557167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:51.557642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:51.558078 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:51.558818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:51.559304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:51.559733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:51.695690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:51.705792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:51.707481 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:51.708728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0767b571-1a62-4eb3-95c4-57406e140390 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1663 microversion: 2.20 time: 0.163209 Aug 07 11:03:51.709289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 513/1030] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:51 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:51.732481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dd63ed3-c70d-4ab9-bbbf-c24e3a167fa6"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:03:51.735141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:51.741577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:51.742065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:51.742497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:51.743414 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:51.744212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:51.745006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:52.060959 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2ceed46-1801-43b5-acac-f8a066499fc6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332259 Aug 07 11:03:52.062365 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 518/1031] 10.222.0.25 () {62 vars in 1364 bytes} [Sun Aug 7 11:03:51 2022] POST /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 11:03:52.205534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:52.205969 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:52.211863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:52.212346 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:52.212773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:52.213593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:52.214240 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:52.214660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:52.461957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-98e157da-ef4b-492f-ba29-4c23edba13dc tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-volume_attachments/8dd63ed3-c70d-4ab9-bbbf-c24e3a167fa6" status: 202 len: 0 microversion: 2.20 time: 0.260706 Aug 07 11:03:52.462560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 514/1032] 10.222.0.25 () {60 vars in 1457 bytes} [Sun Aug 7 11:03:52 2022] DELETE /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-volume_attachments/8dd63ed3-c70d-4ab9-bbbf-c24e3a167fa6 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:03:52.526082 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:03:52.526685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:52.533092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:52.533583 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:52.534028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:52.534734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:52.535442 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:52.535870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:52.569520 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117615) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 11:03:52.638153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8999085-334f-4b7c-a84d-75128d3b5819 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "POST /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/action" status: 202 len: 0 microversion: 2.20 time: 0.115872 Aug 07 11:03:52.638907 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 519/1033] 10.222.0.25 () {62 vars in 1319 bytes} [Sun Aug 7 11:03:52 2022] POST /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 11:03:52.647350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:52.649083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:52.655312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:52.655801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:52.656452 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:52.657216 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:52.657908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:52.658644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:52.816048 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:52.825342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:52.827058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:52.828333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1f7d1c33-afbf-482e-9a7a-e21039e09222 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1671 microversion: 2.20 time: 0.185121 Aug 07 11:03:52.829013 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 515/1034] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:52 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:53.851874 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:53.852497 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:53.862531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:53.863226 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:53.863948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:53.865035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:53.865661 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:53.866505 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:54.009814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:54.018123 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:54.019663 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:54.020833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-863acea5-f096-46e8-8612-4929c265f9a3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.172973 Aug 07 11:03:54.021389 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 520/1035] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:53 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:55.044822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:55.045455 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:55.053004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:55.053521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:55.053964 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:55.054679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:55.055170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:55.055599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:55.200484 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:55.211394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:55.212980 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:55.214219 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4e77def2-db2b-42e0-aead-be957b7c5431 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.174309 Aug 07 11:03:55.214792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 516/1036] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:55 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:56.239270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:56.239827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:56.247065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:56.247549 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:56.247989 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:56.248694 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:56.249460 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:56.250053 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:56.396852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:56.405131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:56.407539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:56.408949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-65f4a63b-2529-4984-b6be-f3696a3da52d tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.173954 Aug 07 11:03:56.409522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 521/1037] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:56 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:57.433329 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:57.434512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:57.441333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:57.441816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:57.442250 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:57.443045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:57.443503 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:57.443925 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:57.584919 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:57.593705 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:57.595237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:57.596424 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4e1161ed-22b6-43bd-af5d-5d3579039955 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.166992 Aug 07 11:03:57.597002 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 517/1038] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:57 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:58.620890 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:58.622613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:58.629506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:58.630002 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:58.630439 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:58.631176 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:58.631635 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:58.632265 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:58.650767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:58.779936 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:58.787747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:58.789376 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:58.790526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b7524d81-f26a-45f8-aaa4-8ae052f1def5 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.173608 Aug 07 11:03:58.791110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 522/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:58 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:03:59.814721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:03:59.815475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:03:59.821987 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:59.822473 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:59.822960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:59.823724 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:03:59.825062 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:03:59.825676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:03:59.983167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:59.991657 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:59.993150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:03:59.994378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5454352c-38d1-48a2-9a56-21f6555921f3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.183572 Aug 07 11:03:59.994953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 518/1040] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:03:59 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:00.555742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:00.556320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:00.563120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:00.563609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:00.564048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:00.564742 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:00.565283 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:00.565734 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:00.590904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-280894cf-7817-4865-b493-1a2ccd8fad18 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/ips" status: 200 len: 145 microversion: 2.1 time: 0.038238 Aug 07 11:04:00.591512 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 523/1041] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 11:04:00 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:01.017750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:01.018337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:01.025452 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:01.026179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:01.026781 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:01.028280 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:01.028899 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:01.029482 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:01.174171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:01.184140 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:01.185884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:01.187096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c4428649-d87e-40c8-8ade-a71d98c0fa2f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.173208 Aug 07 11:04:01.187647 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 519/1042] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:01 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:02.209807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:02.210367 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:02.217849 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:02.218328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:02.218771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:02.219493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:02.219995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:02.220423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:02.362450 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:02.371632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:02.373518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:02.374778 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35fe239d-910a-486f-b377-50d0e35a912e tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.168924 Aug 07 11:04:02.375396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 524/1043] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:02 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:03.030240 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f99775d-2dd8-4b8e-91c8-7ce12dd70e10"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:03.032859 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:03.040829 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:03.041841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:03.042589 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:03.043917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:03.044497 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:03.045018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:03.149982 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:03.397711 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:03.398355 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:03.405875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:03.406541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:03.407087 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:03.407958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:03.408519 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:03.409011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:03.565967 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:03.574725 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:03.576267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:03.577427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-31e02ddd-f9da-46e6-a331-490072f779e2 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.183700 Aug 07 11:04:03.577991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 525/1044] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:03 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:04.601273 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:04.601977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:04.610090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:04.610567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:04.611336 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:04.612059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:04.612513 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:04.612935 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:04.765597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:04.775011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:04.776724 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:04.778452 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0ddc53f3-901c-45ed-aa16-bdb27cc0cc6a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.181066 Aug 07 11:04:04.779264 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 526/1045] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:04 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:05.802147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:05.802835 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:05.809753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:05.810235 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:05.810670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:05.811386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:05.811845 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:05.812271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:06.092293 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:06.100193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:06.101704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:06.102870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4a9c6951-12ba-4233-b0a2-c558868edc89 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.304780 Aug 07 11:04:06.103457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 527/1046] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:05 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:07.126622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:07.127302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:07.129099 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:07.134476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:07.134981 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:07.135410 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:07.136122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:07.137448 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:07.137899 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:07.271540 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:07.280166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:07.281674 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:07.282834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-838067c9-ddd6-447f-be38-aa8b05ce97c3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.160266 Aug 07 11:04:07.283439 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 528/1047] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:07 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:08.305764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:08.306446 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:08.314034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:08.314617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:08.315160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:08.315852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:08.316329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:08.316798 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:08.449068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:08.457014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:08.458514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:08.459707 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0b192228-9c16-4871-8d00-d1ff84397336 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.157988 Aug 07 11:04:08.460262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 529/1048] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:08 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:09.482085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:09.482674 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:09.489294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:09.489802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:09.490239 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:09.490943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:09.491401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:09.491823 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:09.620072 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:09.628683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:09.630185 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:09.631378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8fbdcc8e-b94d-49a0-93ac-44f3b3dc2321 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.153736 Aug 07 11:04:09.631945 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 530/1049] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:09 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:10.654253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:10.654893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:10.661332 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:10.661809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:10.662236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:10.662913 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:10.663377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:10.663800 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:10.797468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:10.805710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:10.807223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:10.808980 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b178599c-16a9-433a-9914-c9f1b46dada4 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.158712 Aug 07 11:04:10.809564 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 531/1050] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:10 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:11.106139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:11.106630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:11.112823 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:11.113298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:11.113730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:11.114412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:11.114862 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:11.115307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:11.138458 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bf3eedda-2f60-4135-98fb-890044be46d3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/ips" status: 200 len: 150 microversion: 2.1 time: 0.036750 Aug 07 11:04:11.139028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 532/1051] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 11:04:11 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:04:11.832120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:11.832719 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:11.839416 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:11.839999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:11.840512 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:11.841207 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:11.841693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:11.842115 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:11.969571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:11.977409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:11.978910 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:11.980608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d3d5df2-e896-4668-aa2c-12a2b2e6807f tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.152123 Aug 07 11:04:11.981164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 533/1052] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:11 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:13.003238 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:13.004477 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:13.010796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:13.011408 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:13.011834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:13.012681 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:13.013131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:13.013553 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:13.038131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=29 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:13.147057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:13.155853 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:13.157372 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:13.158556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0f16dc7d-4ff8-4ee4-b51c-43880d6fd76a tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.159382 Aug 07 11:04:13.159138 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 534/1053] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:12 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 11:04:13.530091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88d14757-a6a0-425d-bf00-13b14f21de00"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:13.532573 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:13.538570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:13.539096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:13.539528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:13.540216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:13.540685 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:13.541090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:17.025837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-60a7c35b-eecb-4f96-b304-f84dae5db2f2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.500056 Aug 07 11:04:17.031829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 535/1054] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 11:04:13 2022] POST /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 194 bytes in 3507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:04:17.037731 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:17.038362 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:17.051372 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:17.052131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:17.052573 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:17.053323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:17.053956 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:17.054386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:17.116352 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8beb40ee-42e5-4b42-a706-4d57f6f40d24 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.090461 Aug 07 11:04:17.124924 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 520/1055] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 11:04:03 2022] POST /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments => generated 194 bytes in 14100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:17.205542 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:17.216375 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:17.217951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:17.219379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-23d2924d-59b2-4b88-b1d6-951d17173a7c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.185992 Aug 07 11:04:17.219931 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 536/1056] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:17 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:18.242119 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:18.242998 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:18.250500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:18.251011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:18.251454 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:18.252146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:18.252608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:18.253033 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:18.385851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:18.394566 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:18.396235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:18.397558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-47e7da67-b175-4c7d-be4a-4fed1148c935 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.159740 Aug 07 11:04:18.398130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 521/1057] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:18 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:18.462630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-9ca584f2-c7bc-4eb1-a9e4-19cc2c54df87 req-ebe45c38-7f46-4b5f-a6ee-9e70f88b2fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3", "name": "network-vif-plugged", "status": "completed", "tag": "1bfe5de2-026e-41d4-bd13-82bed6308b7d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:18.473456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9ca584f2-c7bc-4eb1-a9e4-19cc2c54df87 req-ebe45c38-7f46-4b5f-a6ee-9e70f88b2fb0 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:18.474702 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9ca584f2-c7bc-4eb1-a9e4-19cc2c54df87 req-ebe45c38-7f46-4b5f-a6ee-9e70f88b2fb0 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:18.475166 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9ca584f2-c7bc-4eb1-a9e4-19cc2c54df87 req-ebe45c38-7f46-4b5f-a6ee-9e70f88b2fb0 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:18.487236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-9ca584f2-c7bc-4eb1-a9e4-19cc2c54df87 req-ebe45c38-7f46-4b5f-a6ee-9e70f88b2fb0 service nova] Creating event network-vif-plugged:1bfe5de2-026e-41d4-bd13-82bed6308b7d for instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 on hv-cinder-85032 Aug 07 11:04:18.492521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-9ca584f2-c7bc-4eb1-a9e4-19cc2c54df87 req-ebe45c38-7f46-4b5f-a6ee-9e70f88b2fb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033558 Aug 07 11:04:18.493454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 537/1058] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:19.420431 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:19.421068 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:19.427475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:19.427951 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:19.428377 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:19.429063 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:19.429540 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:19.429959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:19.560019 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:19.567930 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:19.569422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:19.570580 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eab7c061-ceef-44c1-ba3a-2cf8594dada6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.154262 Aug 07 11:04:19.571168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 522/1059] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:19 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:20.594722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:20.595709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:20.602636 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:20.603237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:20.603737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:20.604495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:20.605575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:20.606038 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:20.763171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:20.771378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:20.772980 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:20.774263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-69641d3b-28f3-4479-87ce-b7d768e18a67 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1729 microversion: 2.20 time: 0.183775 Aug 07 11:04:20.774947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 538/1060] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:20 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:21.930099 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:21.930703 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:21.937431 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:21.937907 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:21.938332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:21.939046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:21.939498 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:21.939915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:22.071089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:22.079601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:22.081077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:22.082259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-73ac08aa-c52b-40c1-8e68-8afe4d1026e8 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1716 microversion: 2.20 time: 0.288790 Aug 07 11:04:22.082811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 523/1061] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:04:21 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1716 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:04:22.247793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:04:22.247981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:04:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:04:30.941903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88d14757-a6a0-425d-bf00-13b14f21de00"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:30.945852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:30.954393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=21 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:30.955539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:30.963903 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:30.964923 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:30.965434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:30.966151 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:30.966611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:30.967065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:31.066632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Invalid volume: volume 88d14757-a6a0-425d-bf00-13b14f21de00 is already attached to instances: 62ce0c19-1f84-4341-926f-d60fb8e0273b Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments HTTP/1.1 Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 74 Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:04:31.069023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {"volumeAttachment": {"volumeId": "88d14757-a6a0-425d-bf00-13b14f21de00"}} Aug 07 11:04:31.070475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Invalid volume: volume 88d14757-a6a0-425d-bf00-13b14f21de00 is already attached to instances: 62ce0c19-1f84-4341-926f-d60fb8e0273b Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'server_id': '62ce0c19-1f84-4341-926f-d60fb8e0273b', 'body': {'volumeAttachment': {'volumeId': '88d14757-a6a0-425d-bf00-13b14f21de00'}}} Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88d14757-a6a0-425d-bf00-13b14f21de00 is already attached to instances: 62ce0c19-1f84-4341-926f-d60fb8e0273b Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:31.071404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88d14757-a6a0-425d-bf00-13b14f21de00 is already attached to instances: 62ce0c19-1f84-4341-926f-d60fb8e0273b Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:31.073304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88d14757-a6a0-425d-bf00-13b14f21de00 is already attached to instances: 62ce0c19-1f84-4341-926f-d60fb8e0273b Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 400 to user: Invalid volume: volume 88d14757-a6a0-425d-bf00-13b14f21de00 is already attached to instances: 62ce0c19-1f84-4341-926f-d60fb8e0273b {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-46829fbc-4706-428f-b87f-a4d242e775c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.133667 Aug 07 11:04:31.076278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 539/1062] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 11:04:30 2022] POST /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 11:04:31.150967 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:31.153175 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:31.159972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:31.160712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:31.162849 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:31.163687 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:31.164231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:31.164679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:31.274358 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lazy-loading 'services' on Instance uuid 62ce0c19-1f84-4341-926f-d60fb8e0273b {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:04:31.359437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6761b275-e42e-4e3c-bb37-5bbc8e0d1ee2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments/88d14757-a6a0-425d-bf00-13b14f21de00" status: 202 len: 0 microversion: 2.1 time: 0.212244 Aug 07 11:04:31.360019 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 524/1063] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:04:31 2022] DELETE /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments/88d14757-a6a0-425d-bf00-13b14f21de00 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 11:04:31.368577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:31.371541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:31.380753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:31.381937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:31.381937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:31.382355 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:31.383531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:31.383531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:31.424602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6f21983e-c876-4b6b-86c7-f68e2d8f1a34 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059960 Aug 07 11:04:31.425184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 540/1064] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:31 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:32.439908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:32.442357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:32.449182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:32.449668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:32.450097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:32.450814 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:32.451297 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:32.451721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:32.484975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8e6f9346-ca5a-4ab3-a2e1-ed6965c4016b tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050048 Aug 07 11:04:32.485556 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 525/1065] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:32 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:33.497695 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:33.499891 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:33.506323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:33.506803 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:33.507269 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:33.507958 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:33.508415 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:33.508837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:33.538223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6586422c-3c27-4bc8-af7a-6c74a8195010 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Aug 07 11:04:33.538769 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 541/1066] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:33 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:34.551076 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:34.553251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:34.559733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:34.560233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:34.560695 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:34.561368 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:34.561815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:34.562229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:34.591173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5f356988-b80c-4aca-bae6-12efa38d34fe tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 07 11:04:34.591748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 526/1067] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:34 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:35.603697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:35.606555 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:35.613232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:35.613715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:35.614151 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:35.614843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:35.615329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:35.615755 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:35.644096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-82cc3c2e-e3ed-4efb-9fe8-48a674af038e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Aug 07 11:04:35.644656 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 542/1068] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:35 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:36.656542 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:36.658736 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:36.665174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:36.665658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:36.666123 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:36.666844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:36.667378 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:36.668328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:36.697841 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fbf8d12a-ed84-4f2a-a209-7003fee746db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Aug 07 11:04:36.698394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 527/1069] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:36 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:37.709922 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:37.712160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:37.718470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:37.718973 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:37.719407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:37.720087 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:37.720562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:37.720975 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:37.750632 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-48954c2a-9511-4a5c-9aa3-cc5ddb39fd5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Aug 07 11:04:37.751209 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 543/1070] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:37 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:38.460370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:38.462599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:38.469742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.470226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.470661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.471494 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.471854 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.472374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.504344 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f18a355b-48e9-46ba-85c1-26d67c7af7c0 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047990 Aug 07 11:04:38.504904 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 528/1071] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:38 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:38.515807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:38.516302 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:38.522093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.522575 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.523040 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.523730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.524186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.524613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.554401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4677668d-f468-4d7a-87ef-a173028cdade tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/7f99775d-2dd8-4b8e-91c8-7ce12dd70e10" status: 200 len: 194 microversion: 2.1 time: 0.042928 Aug 07 11:04:38.555000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 544/1072] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Aug 7 11:04:38 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/7f99775d-2dd8-4b8e-91c8-7ce12dd70e10 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:38.761658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:38.769086 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:38.775437 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.776008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.776519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.777399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.778633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.779160 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.810960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-46a4e193-5792-407d-84e0-d0bab87ffaa8 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053053 Aug 07 11:04:38.811935 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 529/1073] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:38 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 11:04:38.878035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:38.878586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:38.885231 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.885710 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.886141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.886833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:38.888173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:38.888592 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:38.914146 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:04:38.988098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7d639b73-41f4-41dd-bce5-e288d921e8db tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 204 len: 0 microversion: 2.1 time: 0.113625 Aug 07 11:04:38.988607 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 545/1074] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:04:38 2022] DELETE /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:04:38.997342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:38.998409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:39.004727 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:39.005210 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:39.005644 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:39.006339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:39.006799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:39.007274 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:39.144510 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:39.152330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-011049c2-e523-4ce7-a3d9-6ce93f8b6a3d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1682 microversion: 2.1 time: 0.159222 Aug 07 11:04:39.152891 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 530/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:38 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:39.898093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65a04b43-94f5-4b4a-ad46-362ff809bfd5"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:39.900524 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:39.907437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:39.907925 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:39.908351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:39.909034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:39.909488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:39.909908 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:40.174246 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:40.174780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:40.181053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:40.181527 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:40.181957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:40.182638 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:40.183123 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:40.183548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:40.315357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:40.322791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b544aaf0-f65a-441e-b4ea-dc615490450c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1682 microversion: 2.1 time: 0.152643 Aug 07 11:04:40.323385 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 531/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:40 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:04:40.562586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1d755236-41b4-4e97-8f2d-54056ca692dc tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "POST /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668569 Aug 07 11:04:40.563260 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 546/1077] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 11:04:39 2022] POST /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:41.344939 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:41.345533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:41.352405 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:41.352986 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:41.353424 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:41.354111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:41.354578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:41.355024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:41.659011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:41.666684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ce5dc232-bc3f-45d1-adfb-cec61dc30787 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 200 len: 1682 microversion: 2.1 time: 0.326229 Aug 07 11:04:41.678949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 532/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:41 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 1682 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:42.099181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-c21e345e-8dc8-4ef5-862a-92fcc4d6b454 req-111d0abe-764c-49c5-b5f6-3d3cb898e2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ce0c19-1f84-4341-926f-d60fb8e0273b", "name": "network-vif-deleted", "tag": "e9f7ef6f-cb8e-41bd-a1ae-524778411cae"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:42.111626 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c21e345e-8dc8-4ef5-862a-92fcc4d6b454 req-111d0abe-764c-49c5-b5f6-3d3cb898e2a1 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:42.112227 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c21e345e-8dc8-4ef5-862a-92fcc4d6b454 req-111d0abe-764c-49c5-b5f6-3d3cb898e2a1 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:42.112716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c21e345e-8dc8-4ef5-862a-92fcc4d6b454 req-111d0abe-764c-49c5-b5f6-3d3cb898e2a1 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:42.125510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-c21e345e-8dc8-4ef5-862a-92fcc4d6b454 req-111d0abe-764c-49c5-b5f6-3d3cb898e2a1 service nova] Creating event network-vif-deleted:e9f7ef6f-cb8e-41bd-a1ae-524778411cae for instance 62ce0c19-1f84-4341-926f-d60fb8e0273b on hv-cinder-85032 Aug 07 11:04:42.131529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-c21e345e-8dc8-4ef5-862a-92fcc4d6b454 req-111d0abe-764c-49c5-b5f6-3d3cb898e2a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036596 Aug 07 11:04:42.132147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 547/1079] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:42.693123 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:42.693733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:42.701859 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:42.702521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:42.703432 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:42.704449 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:42.704906 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:42.705401 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:42.720584 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b HTTP/1.1 Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:04:42.722413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:04:42.724135 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '62ce0c19-1f84-4341-926f-d60fb8e0273b'} Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:04:42.725084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:04:42.726637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:04:42.728852 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:04:42.729699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ab712cbf-c74f-4810-a56f-7febe11af2e5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 404 len: 111 microversion: 2.1 time: 0.040525 Aug 07 11:04:42.730249 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 533/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:42 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:04:42.739667 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2385299f-9375-4c7d-a192-e2ecf004158e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '.version_select at 0x7fc5ed82c3a0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:42.760670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2385299f-9375-4c7d-a192-e2ecf004158e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552713837" status: 202 len: 0 microversion: 2.1 time: 0.025036 Aug 07 11:04:42.761244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 548/1081] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Aug 7 11:04:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552713837 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:04:43.390237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-feb83201-ccc3-4882-900b-638ca3585ff0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: .version_select at 0x7fc5ed9da160>, body: {"keypair": {"name": "tempest-keypair-2077363857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHLM8l6ALxdPl9BNkXhNDQ9WL2J/m8TWoJUoRaQcmpqjNpBBhPKAVWl/WM1L5+iD5xdNP36e6gnKyiPu05T06vGmzls15V25gaJnYLBTYj9wCITUC05CEH8KKw4dJxrZw=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:43.395549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=27 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:43.406634 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-feb83201-ccc3-4882-900b-638ca3585ff0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:04:43.410643 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-feb83201-ccc3-4882-900b-638ca3585ff0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:04:43.436327 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-feb83201-ccc3-4882-900b-638ca3585ff0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050128 Aug 07 11:04:43.436920 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 534/1082] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 11:04:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:44.680338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1157888599", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a58cdcc4-38d5-4381-93af-404135fb0ce7"}], "security_groups": [{"name": "tempest-securitygroup--659048524"}], "key_name": "tempest-keypair-2077363857", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:44.785199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] validate_networks() for [('a58cdcc4-38d5-4381-93af-404135fb0ce7', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:04:45.249081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:04:45.249508 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:04:45.249984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:04:45.250396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:04:45.250808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:04:45.259500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:45.259983 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:45.260416 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:45.261140 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:45.261594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:45.262014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:45.279556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:04:45.283492 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Getting quotas for user 06231f178e0d494084915b9368fa3b9b and project 01328619d6b24d359c0352ef4119ea90. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:04:45.294873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:04:45.297286 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:04:45.343514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eba82173-8737-4c50-97b4-bff38db332e9 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.668216 Aug 07 11:04:45.344167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 549/1083] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:04:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 11:04:45.355081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fc5ed8d7-333a-4cde-bca8-a3fbf0e86df4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:45.355700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fc5ed8d7-333a-4cde-bca8-a3fbf0e86df4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:45.419782 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fc5ed8d7-333a-4cde-bca8-a3fbf0e86df4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:45.427067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fc5ed8d7-333a-4cde-bca8-a3fbf0e86df4 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1242 microversion: 2.1 time: 0.075907 Aug 07 11:04:45.427699 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 535/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:45 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:46.448912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:46.449652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:46.456631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:46.457323 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:46.457820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:46.458716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:46.459360 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:46.459935 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:46.537590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:46.545730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c122f0ee-ebf6-4102-ab8b-0661100e8cb5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1302 microversion: 2.1 time: 0.101458 Aug 07 11:04:46.546305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 550/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:46 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:47.568877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:47.569501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:47.576949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:47.577444 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:47.577880 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:47.578603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:47.579161 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:47.579593 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:47.582530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:47.648008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:47.655530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-915936bd-ff91-45cb-8aa7-188f844cfb5f tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1300 microversion: 2.1 time: 0.092812 Aug 07 11:04:47.656039 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 536/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:47 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:48.122832 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:48.125140 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:48.131537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.132015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.132447 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.133139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.133590 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.134007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.164080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d9f3893a-3cfe-4c58-bc6e-cc8a4748b8a3 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045730 Aug 07 11:04:48.165197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 551/1087] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:48 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:48.307955 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:48.308501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:48.314495 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.315026 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.315475 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.316156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.316609 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.317030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.345730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f71a72f-a41d-4b90-9e68-afe3d9dd8ea8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/7f99775d-2dd8-4b8e-91c8-7ce12dd70e10" status: 200 len: 194 microversion: 2.1 time: 0.042113 Aug 07 11:04:48.346317 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 537/1088] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Aug 7 11:04:48 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/7f99775d-2dd8-4b8e-91c8-7ce12dd70e10 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:48.357377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:48.357953 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:48.364492 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.365039 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.365535 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.366298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.366819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.367326 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.461641 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lazy-loading 'services' on Instance uuid 2d231019-5516-4731-b4ca-91528de2a148 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:04:48.473709 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-faf797d1-bf4a-47f3-8e15-f8f70110eceb req-a5ff6732-ecac-499d-b325-d635c99ab710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c62cc39-5dc6-486f-803f-b0ad90bdab4b", "tag": "2cb920cb-2098-4b63-be44-544d05e3433c"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:48.484507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-faf797d1-bf4a-47f3-8e15-f8f70110eceb req-a5ff6732-ecac-499d-b325-d635c99ab710 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.485454 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-faf797d1-bf4a-47f3-8e15-f8f70110eceb req-a5ff6732-ecac-499d-b325-d635c99ab710 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.486055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-faf797d1-bf4a-47f3-8e15-f8f70110eceb req-a5ff6732-ecac-499d-b325-d635c99ab710 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.502741 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-faf797d1-bf4a-47f3-8e15-f8f70110eceb req-a5ff6732-ecac-499d-b325-d635c99ab710 service nova] Creating event network-changed:2cb920cb-2098-4b63-be44-544d05e3433c for instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b on hv-cinder-85032 Aug 07 11:04:48.508323 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-faf797d1-bf4a-47f3-8e15-f8f70110eceb req-a5ff6732-ecac-499d-b325-d635c99ab710 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038372 Aug 07 11:04:48.509306 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 538/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:48.542190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0201e0f4-ed4d-4bf3-9371-bc13d86d6036 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/7f99775d-2dd8-4b8e-91c8-7ce12dd70e10" status: 202 len: 0 microversion: 2.1 time: 0.189266 Aug 07 11:04:48.542880 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 552/1090] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:04:48 2022] DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/7f99775d-2dd8-4b8e-91c8-7ce12dd70e10 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:04:48.677565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:48.678840 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:48.686411 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.687169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.687764 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.688660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:48.689129 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:48.689528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:48.819982 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:48.827748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-baf0b5a3-9eb3-4238-9ae3-e42c47230665 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1367 microversion: 2.1 time: 0.155384 Aug 07 11:04:48.828316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 539/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:48 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:04:49.849018 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:49.849712 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:49.855861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:49.856389 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:49.856818 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:49.857648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:49.858105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:49.858524 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:49.999528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:50.006936 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4929694c-7927-4484-bd38-97de6d2964bc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1367 microversion: 2.1 time: 0.162646 Aug 07 11:04:50.007503 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 553/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:49 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:50.721784 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:50.722357 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:50.728791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:50.729262 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:50.729688 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:50.730364 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:50.730818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:50.731257 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:50.760976 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0b97e244-569b-49d0-9d45-c817ccc98f69 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/65a04b43-94f5-4b4a-ad46-362ff809bfd5" status: 200 len: 194 microversion: 2.1 time: 0.043226 Aug 07 11:04:50.761545 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 540/1093] 10.222.0.25 () {58 vars in 1413 bytes} [Sun Aug 7 11:04:50 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/65a04b43-94f5-4b4a-ad46-362ff809bfd5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:50.771750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:50.772274 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:50.778182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:50.778662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:50.779148 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:50.779841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:50.780292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:50.780716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:50.784709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:50.864662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lazy-loading 'services' on Instance uuid 2d231019-5516-4731-b4ca-91528de2a148 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:04:50.937038 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-178a3460-7c3e-4b74-9089-fa05c6a75f06 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/65a04b43-94f5-4b4a-ad46-362ff809bfd5" status: 202 len: 0 microversion: 2.1 time: 0.168985 Aug 07 11:04:50.937630 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 554/1094] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:04:50 2022] DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments/65a04b43-94f5-4b4a-ad46-362ff809bfd5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:04:51.027796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:51.028410 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:51.034932 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:51.035438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:51.035877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:51.036561 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:51.037016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:51.037448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:51.164163 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:51.171574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6c9eda8d-0d55-4b13-a186-2471573cd40d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1367 microversion: 2.1 time: 0.147593 Aug 07 11:04:51.172130 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 541/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:51 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:52.193529 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:52.194244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:52.200565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:52.201096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:52.201518 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:52.202209 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:52.202660 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:52.203232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:52.370212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:52.378084 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b1f6e4f8-0364-4133-85eb-43289527fcca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1367 microversion: 2.1 time: 0.189740 Aug 07 11:04:52.378696 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 555/1096] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:52 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:53.167721 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:53.169828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:53.176312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.176803 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.177239 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.177931 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.178388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.178815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.207275 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-acca6567-07df-4cf3-a4db-a27c227a8a37 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043561 Aug 07 11:04:53.207856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 542/1097] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:53 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 11:04:53.323600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:53.325843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:53.332777 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.333253 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.333684 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.334366 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.334815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.335260 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.364698 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-102cd2b8-9303-464d-9597-68608177fc84 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045032 Aug 07 11:04:53.365249 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 556/1098] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:04:53 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 11:04:53.399067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:53.399688 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:53.406230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.407691 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.408486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.409547 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.410222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.411014 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.425586 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:53.426786 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:53.433050 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.433526 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.434027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.434752 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.435228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.435655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.461750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:04:53.541353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-53cb1845-5132-4ce9-b8c8-4e83ca1d6cca tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 204 len: 0 microversion: 2.1 time: 0.119196 Aug 07 11:04:53.542200 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 557/1099] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:04:53 2022] DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 11:04:53.548669 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:53.550861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:53.551593 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:53.556366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-841dc5bb-7955-4d0a-9948-384739251e82 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1367 microversion: 2.1 time: 0.161150 Aug 07 11:04:53.556952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 543/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:53 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:53.557464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.557952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.558411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.559349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:53.559812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:53.560240 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:53.690432 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:53.698107 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35f76e91-ddc3-41bb-b557-dae2040fa14e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1673 microversion: 2.1 time: 0.151487 Aug 07 11:04:53.698671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 558/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:53 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:04:54.578030 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:54.578659 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:54.585739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:54.586618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:54.587098 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:54.587846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:54.588302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:54.589081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:54.720633 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e81255d1-08e4-4d47-b7a3-4be055ca344e req-54288320-d27e-48c2-9d77-4f62550c6fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c62cc39-5dc6-486f-803f-b0ad90bdab4b", "name": "network-vif-plugged", "status": "completed", "tag": "2cb920cb-2098-4b63-be44-544d05e3433c"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:54.729996 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e81255d1-08e4-4d47-b7a3-4be055ca344e req-54288320-d27e-48c2-9d77-4f62550c6fc8 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:54.730470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e81255d1-08e4-4d47-b7a3-4be055ca344e req-54288320-d27e-48c2-9d77-4f62550c6fc8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:54.730893 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e81255d1-08e4-4d47-b7a3-4be055ca344e req-54288320-d27e-48c2-9d77-4f62550c6fc8 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:54.731947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:54.740115 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a629f1fc-93b0-4556-bb69-fd6ed7e8fc53 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1367 microversion: 2.1 time: 0.166660 Aug 07 11:04:54.740684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 544/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:54 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:54.742103 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e81255d1-08e4-4d47-b7a3-4be055ca344e req-54288320-d27e-48c2-9d77-4f62550c6fc8 service nova] Creating event network-vif-plugged:2cb920cb-2098-4b63-be44-544d05e3433c for instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b on hv-cinder-85032 Aug 07 11:04:54.745278 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:54.745898 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:54.747160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e81255d1-08e4-4d47-b7a3-4be055ca344e req-54288320-d27e-48c2-9d77-4f62550c6fc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173547 Aug 07 11:04:54.747824 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 559/1103] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:54.752377 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:54.752863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:54.753293 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:54.753985 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:54.754438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:54.754856 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:54.883949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:54.892145 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33bab2f2-4953-4a30-a7d3-c634da87357d tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1673 microversion: 2.1 time: 0.150330 Aug 07 11:04:54.892741 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 545/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:54 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:55.758724 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:55.759547 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:55.764085 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:55.764771 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:55.771836 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:55.772313 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:55.772743 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:55.773425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:55.773873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:55.774289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:55.908425 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:55.913480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:55.914096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:55.916089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8b75497f-82cb-4665-ba0a-4c6e4b93fa5c tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1367 microversion: 2.1 time: 0.158245 Aug 07 11:04:55.916231 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:55.916825 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 560/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:55 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:55.923748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:55.924241 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:55.924679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:55.925386 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:55.925847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:55.926276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:56.055526 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:56.063233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b43acb76-3ac1-4797-a7f2-754609018c61 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1673 microversion: 2.1 time: 0.153525 Aug 07 11:04:56.063793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 546/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:55 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:56.939091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:56.939713 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:56.946781 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:56.947317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:56.947756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:56.948487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:56.948970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:56.949396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:57.083789 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:57.084409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:57.090876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:57.091399 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:57.091839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:57.092546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:57.093541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:57.094174 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:57.131836 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:57.139329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-22aebb07-b689-4ae3-bf0d-e114ea8dbd5a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1557 microversion: 2.1 time: 0.205876 Aug 07 11:04:57.140035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 561/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:56 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1557 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:04:57.160168 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:57.160674 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:57.166631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:57.167184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:57.167612 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:57.168311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:57.168770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:57.169234 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:57.194064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b64b05230b940eba992a063ea7cd778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3be73ff916420f8c9eb418ef5f6716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:04:57.202168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-57b2ae9b-0e0f-4a7c-b48d-76ba1f0d41c8 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 200 len: 1605 microversion: 2.1 time: 0.122040 Aug 07 11:04:57.202822 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 547/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:57 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 1605 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:04:57.284117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-266da75d-5042-4cb9-a12c-f3b4b5265953 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128261 Aug 07 11:04:57.284928 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 562/1109] 10.222.0.25 () {58 vars in 1275 bytes} [Sun Aug 7 11:04:57 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:04:57.361064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-c52daf81-abd9-466f-aa59-974685589955 req-d8618488-3d77-4fc6-bf16-018509fb2020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d231019-5516-4731-b4ca-91528de2a148", "name": "network-vif-deleted", "tag": "3a58ac62-2cc4-4494-97d0-34b0b943dc9a"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:57.380859 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c52daf81-abd9-466f-aa59-974685589955 req-d8618488-3d77-4fc6-bf16-018509fb2020 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:57.381331 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c52daf81-abd9-466f-aa59-974685589955 req-d8618488-3d77-4fc6-bf16-018509fb2020 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:57.382309 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c52daf81-abd9-466f-aa59-974685589955 req-d8618488-3d77-4fc6-bf16-018509fb2020 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:57.400648 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-c52daf81-abd9-466f-aa59-974685589955 req-d8618488-3d77-4fc6-bf16-018509fb2020 service nova] Creating event network-vif-deleted:3a58ac62-2cc4-4494-97d0-34b0b943dc9a for instance 2d231019-5516-4731-b4ca-91528de2a148 on hv-cinder-85032 Aug 07 11:04:57.413047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-c52daf81-abd9-466f-aa59-974685589955 req-d8618488-3d77-4fc6-bf16-018509fb2020 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052156 Aug 07 11:04:57.414737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 548/1110] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:04:58.224055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:58.224673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:04:58.231202 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:58.231704 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:58.232143 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:58.232865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:58.233329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:58.234023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:58.248765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] HTTP exception thrown: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Request method failure captured: Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 HTTP/1.1 Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nmzfkIRqeqbdI3lBZyHB6h7-fcfW9ujMcwLrD_gguPZHYxPxpZvT3lq-msT3u3W0s7w9leoHl1_Qzikz_uQ1rnZjbYESxtr6xtLFKx5MlXzbN3BdDC3wzYn5q4o10AxGSTVcGE5qKuT7IX0cocL8MAM4VOLZXHw-1Dk6jrro88SjU Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:04:58.250629 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c3be73ff916420f8c9eb418ef5f6716", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 2b64b05230b940eba992a063ea7cd778 Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:04:58.252066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '2d231019-5516-4731-b4ca-91528de2a148'} Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:04:58.252833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:04:58.254096 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:04:58.255246 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Returning 404 to user: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:04:58.255246 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f19e407d-bb5b-4667-a739-70ef971edc7c tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 404 len: 111 microversion: 2.1 time: 0.032607 Aug 07 11:04:58.256098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 563/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:04:58 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:04:58.264559 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2468a844-c24a-496a-a4b3-29898eac293e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '.version_select at 0x7fc5ed9da160>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:04:58.287791 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2468a844-c24a-496a-a4b3-29898eac293e tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464950634" status: 202 len: 0 microversion: 2.1 time: 0.030133 Aug 07 11:04:58.288370 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 549/1112] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Aug 7 11:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464950634 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:04:58.754904 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-2ac7b82a-f13c-4527-9eed-48da72f2ce72 req-0d37d5ba-c353-44f0-a09d-76cb4ec15257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c62cc39-5dc6-486f-803f-b0ad90bdab4b", "tag": "2cb920cb-2098-4b63-be44-544d05e3433c"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:04:58.766528 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2ac7b82a-f13c-4527-9eed-48da72f2ce72 req-0d37d5ba-c353-44f0-a09d-76cb4ec15257 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:04:58.766938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2ac7b82a-f13c-4527-9eed-48da72f2ce72 req-0d37d5ba-c353-44f0-a09d-76cb4ec15257 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:04:58.767567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2ac7b82a-f13c-4527-9eed-48da72f2ce72 req-0d37d5ba-c353-44f0-a09d-76cb4ec15257 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:04:58.779650 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-2ac7b82a-f13c-4527-9eed-48da72f2ce72 req-0d37d5ba-c353-44f0-a09d-76cb4ec15257 service nova] Creating event network-changed:2cb920cb-2098-4b63-be44-544d05e3433c for instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b on hv-cinder-85032 Aug 07 11:04:58.785399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-2ac7b82a-f13c-4527-9eed-48da72f2ce72 req-0d37d5ba-c353-44f0-a09d-76cb4ec15257 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121048 Aug 07 11:04:58.786180 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 564/1113] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:05:01.347298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:01.347936 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:01.355890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:01.356374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:01.356808 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:01.357573 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:01.358025 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:01.358446 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:01.372220 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] HTTP exception thrown: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Request method failure captured: Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 HTTP/1.1 Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nmzfkIRqeqbdI3lBZyHB6h7-fcfW9ujMcwLrD_gguPZHYxPxpZvT3lq-msT3u3W0s7w9leoHl1_Qzikz_uQ1rnZjbYESxtr6xtLFKx5MlXzbN3BdDC3wzYn5q4o10AxGSTVcGE5qKuT7IX0cocL8MAM4VOLZXHw-1Dk6jrro88SjU Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:01.374413 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c3be73ff916420f8c9eb418ef5f6716", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 2b64b05230b940eba992a063ea7cd778 Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.376046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '2d231019-5516-4731-b4ca-91528de2a148'} Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:01.376948 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.378499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.380600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Returning 404 to user: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:01.380600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-65f08dda-57a2-451d-add8-773ee987d2de tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 404 len: 111 microversion: 2.1 time: 0.032909 Aug 07 11:05:01.380600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 550/1114] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:05:01 2022] DELETE /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:05:01.385723 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:01.386416 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: 2d231019-5516-4731-b4ca-91528de2a148] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:01.388951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:01.394496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:01.394998 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:01.395435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:01.396122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:01.396576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:01.396998 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:01.413658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] HTTP exception thrown: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Request method failure captured: Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 HTTP/1.1 Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nmzfkIRqeqbdI3lBZyHB6h7-fcfW9ujMcwLrD_gguPZHYxPxpZvT3lq-msT3u3W0s7w9leoHl1_Qzikz_uQ1rnZjbYESxtr6xtLFKx5MlXzbN3BdDC3wzYn5q4o10AxGSTVcGE5qKuT7IX0cocL8MAM4VOLZXHw-1Dk6jrro88SjU Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:05:01.415356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c3be73ff916420f8c9eb418ef5f6716", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 2b64b05230b940eba992a063ea7cd778 Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.416957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '2d231019-5516-4731-b4ca-91528de2a148'} Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:01.420788 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. Aug 07 11:05:01.422990 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:01.425189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Returning 404 to user: Instance 2d231019-5516-4731-b4ca-91528de2a148 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:01.425189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b7153563-89ab-4aef-a984-d2c3db6bdab5 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148" status: 404 len: 111 microversion: 2.1 time: 0.035290 Aug 07 11:05:01.425189 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 565/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:05:01 2022] GET /compute/v2.1/servers/2d231019-5516-4731-b4ca-91528de2a148 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:05:02.556496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:02.557082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:02.563401 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:02.564398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:02.564873 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:02.565670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:02.566128 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:02.566553 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:02.580312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] HTTP exception thrown: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Request method failure captured: Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb HTTP/1.1 Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nmzfkIRqeqbdI3lBZyHB6h7-fcfW9ujMcwLrD_gguPZHYxPxpZvT3lq-msT3u3W0s7w9leoHl1_Qzikz_uQ1rnZjbYESxtr6xtLFKx5MlXzbN3BdDC3wzYn5q4o10AxGSTVcGE5qKuT7IX0cocL8MAM4VOLZXHw-1Dk6jrro88SjU Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:02.581911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c3be73ff916420f8c9eb418ef5f6716", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 2b64b05230b940eba992a063ea7cd778 Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.583304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': 'cad22310-bbff-4a4d-b3e1-08f2f0ee19bb'} Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:02.584083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.585490 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.587072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Returning 404 to user: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:02.587072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2d69826d-84af-4ebc-8383-857e37b69079 tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 404 len: 111 microversion: 2.1 time: 0.030694 Aug 07 11:05:02.587072 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 551/1116] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:05:02 2022] DELETE /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:05:02.591657 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:02.592298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] [instance: cad22310-bbff-4a4d-b3e1-08f2f0ee19bb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:02.599083 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:02.599565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:02.599999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:02.600682 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:02.601135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:02.601557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:02.615049 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] HTTP exception thrown: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Request method failure captured: Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb HTTP/1.1 Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nmzfkIRqeqbdI3lBZyHB6h7-fcfW9ujMcwLrD_gguPZHYxPxpZvT3lq-msT3u3W0s7w9leoHl1_Qzikz_uQ1rnZjbYESxtr6xtLFKx5MlXzbN3BdDC3wzYn5q4o10AxGSTVcGE5qKuT7IX0cocL8MAM4VOLZXHw-1Dk6jrro88SjU Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:05:02.616556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3c3be73ff916420f8c9eb418ef5f6716", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3c3be73ff916420f8c9eb418ef5f6716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 3c3be73ff916420f8c9eb418ef5f6716 Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1529484622 Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 2b64b05230b940eba992a063ea7cd778 Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-1529484622-project Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.618188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': 'cad22310-bbff-4a4d-b3e1-08f2f0ee19bb'} Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:02.619164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. Aug 07 11:05:02.620625 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:02.621984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] Returning 404 to user: Instance cad22310-bbff-4a4d-b3e1-08f2f0ee19bb could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:02.621984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-be880534-2a08-4f0d-b959-8746453e5d9b tempest-AttachVolumeTestJSON-1529484622 tempest-AttachVolumeTestJSON-1529484622-project] 10.222.0.25 "GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb" status: 404 len: 111 microversion: 2.1 time: 0.030046 Aug 07 11:05:02.621984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 566/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:05:02 2022] GET /compute/v2.1/servers/cad22310-bbff-4a4d-b3e1-08f2f0ee19bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 11:05:18.968343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:18.970893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:18.973206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:18.973934 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=73 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:18.979905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:18.980388 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:18.980821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:18.981512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:18.981971 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:18.982394 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:19.015760 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-684a1cf4-a3d6-4790-a742-4c275b9d4bd3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051331 Aug 07 11:05:19.016305 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 552/1118] 10.222.0.25 () {60 vars in 1343 bytes} [Sun Aug 7 11:05:18 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:05:19.077721 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:19.078241 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:19.081356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:19.082028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:19.087941 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:19.088424 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:19.088864 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:19.089559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:19.090034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:19.090453 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:19.116793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:05:19.193996 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2329d683-ac1d-41c3-9bb3-85610097794c tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 204 len: 0 microversion: 2.20 time: 0.119844 Aug 07 11:05:19.194617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 567/1119] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Aug 7 11:05:19 2022] DELETE /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 11:05:19.203170 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:19.203779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:19.210172 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:19.210683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:19.211224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:19.212023 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:19.212489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:19.212917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:19.341390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:19.349396 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:19.350901 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:19.352096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fa43fdba-fef4-45b6-a848-a70b87cf994b tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.152842 Aug 07 11:05:19.352643 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 553/1120] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:05:19 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:05:20.376765 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:20.377468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:20.383768 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:20.384349 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:20.384592 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:20.385276 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:20.385724 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:20.386139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:20.524602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:20.533444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:20.535045 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:20.536203 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-987f5c0a-feb1-441d-828c-da87725b1975 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.164564 Aug 07 11:05:20.536747 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 568/1121] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:05:20 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:05:21.557920 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:21.558460 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:21.564943 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:21.565970 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:21.566569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:21.567298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:21.567761 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:21.568185 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:21.792345 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:21.801780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:21.802947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b757e3f47e44b9ba3645d12b20f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f23b23bf2f84fdf8401acf4d73e1f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:21.804414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-15aa46d5-7261-41e7-af80-0dd66cef6d56 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 200 len: 1722 microversion: 2.20 time: 0.250401 Aug 07 11:05:21.805001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 554/1122] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:05:21 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 11:05:22.324605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-4dce4e64-ba76-4279-be08-bbe103e9c0de req-50d9f3a0-bece-4d4b-b4ac-6834d42aca33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3", "name": "network-vif-deleted", "tag": "1bfe5de2-026e-41d4-bd13-82bed6308b7d"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:05:22.337952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4dce4e64-ba76-4279-be08-bbe103e9c0de req-50d9f3a0-bece-4d4b-b4ac-6834d42aca33 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:22.338506 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4dce4e64-ba76-4279-be08-bbe103e9c0de req-50d9f3a0-bece-4d4b-b4ac-6834d42aca33 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:22.339182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4dce4e64-ba76-4279-be08-bbe103e9c0de req-50d9f3a0-bece-4d4b-b4ac-6834d42aca33 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:22.354562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-4dce4e64-ba76-4279-be08-bbe103e9c0de req-50d9f3a0-bece-4d4b-b4ac-6834d42aca33 service nova] Creating event network-vif-deleted:1bfe5de2-026e-41d4-bd13-82bed6308b7d for instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 on hv-cinder-85032 Aug 07 11:05:22.359811 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-4dce4e64-ba76-4279-be08-bbe103e9c0de req-50d9f3a0-bece-4d4b-b4ac-6834d42aca33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190882 Aug 07 11:05:22.363679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 569/1123] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:05:22.827752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:22.828534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:22.836400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:22.836895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:22.837330 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:22.838045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:22.838504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:22.838947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:22.852706 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] HTTP exception thrown: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Request method failure captured: Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 HTTP/1.1 Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nd-PlvLC6NWIPVGiKlf5k1a5PmdUw5MsiqzJf6qAEfydbndj4TMrOqLZZ5SPFo_9gkEOJXWCrbbga59oV5UTupJnNmzWX0fHf-CQAlJts3XFLKAHCDWrTDw43ODQqit_U7KbfEANZCFzRLOTHkJsBUg8WdLhIRiLteoUyzo1puVYM Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:22.854367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f23b23bf2f84fdf8401acf4d73e1f4b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 2b757e3f47e44b9ba3645d12b20f7502 Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:22.855926 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3'} Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:22.856729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:22.857996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:22.859505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Returning 404 to user: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:22.859505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-86757dbe-79ec-404b-876d-ccd0b38d12eb tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 404 len: 111 microversion: 2.20 time: 0.032033 Aug 07 11:05:22.859505 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 555/1124] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:05:22 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 11:05:22.866867 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8251d4e-247e-4c64-828e-aed4d4ae7ff6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '.version_select at 0x7fc5ed7c5d30>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:22.885753 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8251d4e-247e-4c64-828e-aed4d4ae7ff6 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172137760" status: 204 len: 0 microversion: 2.20 time: 0.024071 Aug 07 11:05:22.886254 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 570/1125] 10.222.0.25 () {60 vars in 1259 bytes} [Sun Aug 7 11:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172137760 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 11:05:24.984315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:24.984820 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:24.991565 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:24.992043 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:24.992471 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:24.993188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:24.993635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:24.994052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:25.007974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] HTTP exception thrown: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Request method failure captured: Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 HTTP/1.1 Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nd-PlvLC6NWIPVGiKlf5k1a5PmdUw5MsiqzJf6qAEfydbndj4TMrOqLZZ5SPFo_9gkEOJXWCrbbga59oV5UTupJnNmzWX0fHf-CQAlJts3XFLKAHCDWrTDw43ODQqit_U7KbfEANZCFzRLOTHkJsBUg8WdLhIRiLteoUyzo1puVYM Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:25.009568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f23b23bf2f84fdf8401acf4d73e1f4b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 2b757e3f47e44b9ba3645d12b20f7502 Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.011150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3'} Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:25.012046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.013857 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.015608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Returning 404 to user: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:25.015608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0f95d1aa-220a-4bf0-85c1-36d32cd9dc65 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 404 len: 111 microversion: 2.20 time: 0.030807 Aug 07 11:05:25.015608 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 556/1126] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Aug 7 11:05:24 2022] DELETE /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 11:05:25.021179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:25.021905 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:25.028615 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:25.029094 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:25.029525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:25.030206 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:25.030654 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:25.031106 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:25.043957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] HTTP exception thrown: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Request method failure captured: Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 HTTP/1.1 Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nd-PlvLC6NWIPVGiKlf5k1a5PmdUw5MsiqzJf6qAEfydbndj4TMrOqLZZ5SPFo_9gkEOJXWCrbbga59oV5UTupJnNmzWX0fHf-CQAlJts3XFLKAHCDWrTDw43ODQqit_U7KbfEANZCFzRLOTHkJsBUg8WdLhIRiLteoUyzo1puVYM Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:05:25.045544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f23b23bf2f84fdf8401acf4d73e1f4b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 2b757e3f47e44b9ba3645d12b20f7502 Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.047247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3'} Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:25.048335 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. Aug 07 11:05:25.049984 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:25.051548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Returning 404 to user: Instance 6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:25.051548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d7f17b71-64b8-4bae-8359-a4d8917a3565 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3" status: 404 len: 111 microversion: 2.20 time: 0.030845 Aug 07 11:05:25.051548 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 571/1127] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:05:25 2022] GET /compute/v2.1/servers/6d738aaf-8ac0-40fc-bc1f-d9c2a5576ca3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 11:05:26.182966 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:26.183467 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:26.189929 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:26.190433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:26.190961 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:26.191648 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:26.192096 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:26.192512 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:26.207875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] HTTP exception thrown: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Request method failure captured: Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e HTTP/1.1 Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75nd-PlvLC6NWIPVGiKlf5k1a5PmdUw5MsiqzJf6qAEfydbndj4TMrOqLZZ5SPFo_9gkEOJXWCrbbga59oV5UTupJnNmzWX0fHf-CQAlJts3XFLKAHCDWrTDw43ODQqit_U7KbfEANZCFzRLOTHkJsBUg8WdLhIRiLteoUyzo1puVYM Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:26.209406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f23b23bf2f84fdf8401acf4d73e1f4b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 2b757e3f47e44b9ba3645d12b20f7502 Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.211001 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '72ec2284-c34f-4e70-b19f-4e762542600e'} Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:26.211879 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.213333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.214903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Returning 404 to user: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:26.214903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5929e162-ba5b-4480-abf1-a3fc7e5bff28 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "DELETE /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 404 len: 111 microversion: 2.20 time: 0.031655 Aug 07 11:05:26.214903 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 557/1128] 10.222.0.25 () {60 vars in 1280 bytes} [Sun Aug 7 11:05:26 2022] DELETE /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 11:05:26.219419 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:26.220032 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] [instance: 72ec2284-c34f-4e70-b19f-4e762542600e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:26.227435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:26.227912 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:26.228348 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:26.229034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:26.229488 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:26.229909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:26.243321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] HTTP exception thrown: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Request method failure captured: Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e HTTP/1.1 Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75nd-PlvLC6NWIPVGiKlf5k1a5PmdUw5MsiqzJf6qAEfydbndj4TMrOqLZZ5SPFo_9gkEOJXWCrbbga59oV5UTupJnNmzWX0fHf-CQAlJts3XFLKAHCDWrTDw43ODQqit_U7KbfEANZCFzRLOTHkJsBUg8WdLhIRiLteoUyzo1puVYM Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:05:26.244842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1f23b23bf2f84fdf8401acf4d73e1f4b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1f23b23bf2f84fdf8401acf4d73e1f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 1f23b23bf2f84fdf8401acf4d73e1f4b Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-33857405 Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 2b757e3f47e44b9ba3645d12b20f7502 Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-33857405-project Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.246491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '72ec2284-c34f-4e70-b19f-4e762542600e'} Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:26.247428 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. Aug 07 11:05:26.248894 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:26.250221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] Returning 404 to user: Instance 72ec2284-c34f-4e70-b19f-4e762542600e could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:26.250221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-42b8ecf6-f939-4595-8707-5f340e2afca3 tempest-AttachVolumeShelveTestJSON-33857405 tempest-AttachVolumeShelveTestJSON-33857405-project] 10.222.0.25 "GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e" status: 404 len: 111 microversion: 2.20 time: 0.030785 Aug 07 11:05:26.250221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 572/1129] 10.222.0.25 () {60 vars in 1277 bytes} [Sun Aug 7 11:05:26 2022] GET /compute/v2.1/servers/72ec2284-c34f-4e70-b19f-4e762542600e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 11:05:30.398720 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f550e4d-bdaa-4d4f-82b6-500c972fa541 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Action: 'create', calling method: .version_select at 0x7fc5edba3f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1702078133", "metadata": {"Type": "work"}}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f550e4d-bdaa-4d4f-82b6-500c972fa541 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Request method failure captured: Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 122 Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75x6iTgBwHJmC7RQivtQjezAtIQJBtfmwrSxH5iaddcWmObqw8ymK5XiZOQvMACy6esGaA6RzKYqrlVqBvYakRXOW2z7FW3zr6JhUsFY2ZhuRbRwGek5k4d6L4K4DKBUsxIxpXGfBphlF709hwTFAGndqaYrZ2EgFAo8srs36seoiv0 Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:30.410414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b689949b03345e3a7ce7bf7a2ac77cd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: c128883f6b4a4d8ab6841a693c782feb Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1702078133", "metadata": {"Type": "work"}}} Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: Aug 07 11:05:30.412029 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1702078133', 'metadata': {'Type': 'work'}}}} Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise error Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi '#$%' Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:30.413053 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 11:05:30.414846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 11:05:30.416272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 11:05:30.416272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.416272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f550e4d-bdaa-4d4f-82b6-500c972fa541 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:30.416272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4f550e4d-bdaa-4d4f-82b6-500c972fa541 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125363 Aug 07 11:05:30.416272 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 558/1130] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Aug 7 11:05:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 11:05:30.421603 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7edb700c-ff50-4a12-8c10-d86f596b3430 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Action: 'create', calling method: .version_select at 0x7fc5ed7c5550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1364309656", "metadata": {"Type": "work"}}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7edb700c-ff50-4a12-8c10-d86f596b3430 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Request method failure captured: Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 120 Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75x6iTgBwHJmC7RQivtQjezAtIQJBtfmwrSxH5iaddcWmObqw8ymK5XiZOQvMACy6esGaA6RzKYqrlVqBvYakRXOW2z7FW3zr6JhUsFY2ZhuRbRwGek5k4d6L4K4DKBUsxIxpXGfBphlF709hwTFAGndqaYrZ2EgFAo8srs36seoiv0 Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:05:30.426374 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b689949b03345e3a7ce7bf7a2ac77cd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c128883f6b4a4d8ab6841a693c782feb Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1364309656", "metadata": {"Type": "work"}}} Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: Aug 07 11:05:30.428092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1364309656', 'metadata': {'Type': 'work'}}}} Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise error Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi '0' Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:30.429068 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 11:05:30.431310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 11:05:30.433233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 11:05:30.433233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.433233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7edb700c-ff50-4a12-8c10-d86f596b3430 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:30.433233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7edb700c-ff50-4a12-8c10-d86f596b3430 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010080 Aug 07 11:05:30.433233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 573/1131] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Aug 7 11:05:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 11:05:30.436813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-066b59e4-5ea2-4c28-b5e1-6a541bfa8c2e tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Action: 'create', calling method: .version_select at 0x7fc5eda77b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-396244755", "metadata": {"Type": "work"}}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-066b59e4-5ea2-4c28-b5e1-6a541bfa8c2e tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Request method failure captured: Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 118 Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75x6iTgBwHJmC7RQivtQjezAtIQJBtfmwrSxH5iaddcWmObqw8ymK5XiZOQvMACy6esGaA6RzKYqrlVqBvYakRXOW2z7FW3zr6JhUsFY2ZhuRbRwGek5k4d6L4K4DKBUsxIxpXGfBphlF709hwTFAGndqaYrZ2EgFAo8srs36seoiv0 Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:30.441574 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b689949b03345e3a7ce7bf7a2ac77cd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: c128883f6b4a4d8ab6841a693c782feb Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-396244755", "metadata": {"Type": "work"}}} Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: Aug 07 11:05:30.443403 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-396244755', 'metadata': {'Type': 'work'}}}} Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise error Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi '' Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:30.444384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 11:05:30.447066 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 11:05:30.448439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 11:05:30.448439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.448439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-066b59e4-5ea2-4c28-b5e1-6a541bfa8c2e tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:30.448439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-066b59e4-5ea2-4c28-b5e1-6a541bfa8c2e tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009972 Aug 07 11:05:30.448439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 559/1132] 10.222.0.25 () {60 vars in 1156 bytes} [Sun Aug 7 11:05:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 11:05:30.452738 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-54443151-6eb2-4d6b-a948-593b0420e809 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Calling method '.version_select at 0x7fc5ed80a550>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:30.483475 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-54443151-6eb2-4d6b-a948-593b0420e809 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] HTTP exception thrown: Volume tempest-invalid-929645488 could not be found. Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-54443151-6eb2-4d6b-a948-593b0420e809 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Request method failure captured: Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-929645488 HTTP/1.1 Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75x6iTgBwHJmC7RQivtQjezAtIQJBtfmwrSxH5iaddcWmObqw8ymK5XiZOQvMACy6esGaA6RzKYqrlVqBvYakRXOW2z7FW3zr6JhUsFY2ZhuRbRwGek5k4d6L4K4DKBUsxIxpXGfBphlF709hwTFAGndqaYrZ2EgFAo8srs36seoiv0 Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:05:30.485715 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b689949b03345e3a7ce7bf7a2ac77cd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c128883f6b4a4d8ab6841a693c782feb Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Volume tempest-invalid-929645488 could not be found. Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': 'tempest-invalid-929645488'} Aug 07 11:05:30.487386 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-929645488 could not be found. (HTTP 404) (Request-ID: req-db12418c-9f8f-4129-a6ad-29018b806658) Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.488631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 11:05:30.489865 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-929645488 could not be found. Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:30.492334 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-929645488 could not be found. Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-929645488 could not be found. Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-54443151-6eb2-4d6b-a948-593b0420e809 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Returning 404 to user: Volume tempest-invalid-929645488 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-54443151-6eb2-4d6b-a948-593b0420e809 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-929645488" status: 404 len: 98 microversion: 2.1 time: 0.038740 Aug 07 11:05:30.493812 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 574/1133] 10.222.0.25 () {58 vars in 1215 bytes} [Sun Aug 7 11:05:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-929645488 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 11:05:30.497099 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f16d8f9b-33e3-49d5-b3b1-1b5d2465005e tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003744 Aug 07 11:05:30.497592 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 560/1134] 10.222.0.25 () {58 vars in 1140 bytes} [Sun Aug 7 11:05:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 07 11:05:30.505783 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-799695f5-72d3-4e4e-83fc-23c0a876bf0a tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003838 Aug 07 11:05:30.506265 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 575/1135] 10.222.0.25 () {58 vars in 1137 bytes} [Sun Aug 7 11:05:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 11:05:30.514393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cde1ec5d-5ca0-45d5-8298-4d98132b163b tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Calling method '.version_select at 0x7fc5edba3f70>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:30.543617 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-cde1ec5d-5ca0-45d5-8298-4d98132b163b tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] HTTP exception thrown: Volume 1f7e1198-9e56-46f2-892f-772d7496720b could not be found. Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cde1ec5d-5ca0-45d5-8298-4d98132b163b tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Request method failure captured: Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/os-volumes/1f7e1198-9e56-46f2-892f-772d7496720b HTTP/1.1 Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75x6iTgBwHJmC7RQivtQjezAtIQJBtfmwrSxH5iaddcWmObqw8ymK5XiZOQvMACy6esGaA6RzKYqrlVqBvYakRXOW2z7FW3zr6JhUsFY2ZhuRbRwGek5k4d6L4K4DKBUsxIxpXGfBphlF709hwTFAGndqaYrZ2EgFAo8srs36seoiv0 Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:05:30.545622 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b689949b03345e3a7ce7bf7a2ac77cd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: c128883f6b4a4d8ab6841a693c782feb Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Volume 1f7e1198-9e56-46f2-892f-772d7496720b could not be found. Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '1f7e1198-9e56-46f2-892f-772d7496720b'} Aug 07 11:05:30.547282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f7e1198-9e56-46f2-892f-772d7496720b could not be found. (HTTP 404) (Request-ID: req-8a69f676-02b0-403f-9666-a14858765f62) Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.548281 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 11:05:30.549701 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f7e1198-9e56-46f2-892f-772d7496720b could not be found. Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 11:05:30.551171 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f7e1198-9e56-46f2-892f-772d7496720b could not be found. Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f7e1198-9e56-46f2-892f-772d7496720b could not be found. Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cde1ec5d-5ca0-45d5-8298-4d98132b163b tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Returning 404 to user: Volume 1f7e1198-9e56-46f2-892f-772d7496720b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cde1ec5d-5ca0-45d5-8298-4d98132b163b tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/1f7e1198-9e56-46f2-892f-772d7496720b" status: 404 len: 109 microversion: 2.1 time: 0.036202 Aug 07 11:05:30.552823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 561/1136] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 11:05:30 2022] DELETE /compute/v2.1/os-volumes/1f7e1198-9e56-46f2-892f-772d7496720b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:05:30.557104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0aab2832-20ac-477e-b7bb-9c74db3946a7 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Calling method '.version_select at 0x7fc5ed7c5550>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:30.584493 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-0aab2832-20ac-477e-b7bb-9c74db3946a7 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] HTTP exception thrown: Volume c06b5cd3-9399-452d-86b6-59a47863bcca could not be found. Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0aab2832-20ac-477e-b7bb-9c74db3946a7 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Request method failure captured: Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-volumes/c06b5cd3-9399-452d-86b6-59a47863bcca HTTP/1.1 Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75x6iTgBwHJmC7RQivtQjezAtIQJBtfmwrSxH5iaddcWmObqw8ymK5XiZOQvMACy6esGaA6RzKYqrlVqBvYakRXOW2z7FW3zr6JhUsFY2ZhuRbRwGek5k4d6L4K4DKBUsxIxpXGfBphlF709hwTFAGndqaYrZ2EgFAo8srs36seoiv0 Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:05:30.586437 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b689949b03345e3a7ce7bf7a2ac77cd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b689949b03345e3a7ce7bf7a2ac77cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 7b689949b03345e3a7ce7bf7a2ac77cd Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-1763915611 Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: c128883f6b4a4d8ab6841a693c782feb Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-1763915611-project Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Volume c06b5cd3-9399-452d-86b6-59a47863bcca could not be found. Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': 'c06b5cd3-9399-452d-86b6-59a47863bcca'} Aug 07 11:05:30.588080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c06b5cd3-9399-452d-86b6-59a47863bcca could not be found. (HTTP 404) (Request-ID: req-969263e3-e5a8-412d-b651-7d20436c7cbf) Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.589059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 11:05:30.590484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c06b5cd3-9399-452d-86b6-59a47863bcca could not be found. Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 11:05:30.591808 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c06b5cd3-9399-452d-86b6-59a47863bcca could not be found. Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c06b5cd3-9399-452d-86b6-59a47863bcca could not be found. Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0aab2832-20ac-477e-b7bb-9c74db3946a7 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] Returning 404 to user: Volume c06b5cd3-9399-452d-86b6-59a47863bcca could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0aab2832-20ac-477e-b7bb-9c74db3946a7 tempest-VolumesNegativeTest-1763915611 tempest-VolumesNegativeTest-1763915611-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c06b5cd3-9399-452d-86b6-59a47863bcca" status: 404 len: 109 microversion: 2.1 time: 0.034514 Aug 07 11:05:30.593237 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 576/1137] 10.222.0.25 () {58 vars in 1245 bytes} [Sun Aug 7 11:05:30 2022] GET /compute/v2.1/os-volumes/c06b5cd3-9399-452d-86b6-59a47863bcca => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:05:57.220045 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:05:57.220659 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:05:57.910845 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=12 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:57.911771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=24 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:57.917141 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1623730802", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "networks": [{"uuid": "87ed2e4f-2452-4de0-8db6-8b2b93bc2c6d"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:05:57.972244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] validate_networks() for [('87ed2e4f-2452-4de0-8db6-8b2b93bc2c6d', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:05:58.656674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:05:58.657268 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:05:58.657554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:05:58.657959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:05:58.658367 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:05:58.667157 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:58.667637 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:58.668064 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:58.668778 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:58.669228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:58.669645 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:58.688186 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Getting quotas for project 4867894c8e5840c198d233005521fd99. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:05:58.692618 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Getting quotas for user c8d7c5d4a1634a71bad9102577bef117 and project 4867894c8e5840c198d233005521fd99. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:05:58.703548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:05:58.705800 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:05:58.754698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0ebed232-be52-4d88-8cc5-879df96bdfa8 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845925 Aug 07 11:05:58.761486 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 562/1138] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:05:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 11:05:58.764970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:58.766331 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:58.771672 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0f999372-8a8f-4d9b-a955-fc24961ef9b6 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:58.772403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0f999372-8a8f-4d9b-a955-fc24961ef9b6 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:58.835196 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0f999372-8a8f-4d9b-a955-fc24961ef9b6 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:58.841881 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0f999372-8a8f-4d9b-a955-fc24961ef9b6 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1214 microversion: 2.1 time: 0.079233 Aug 07 11:05:58.842448 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 577/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:05:58 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:05:59.864249 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:05:59.864933 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:05:59.871596 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:59.872074 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:59.873052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:59.873182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:05:59.873631 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:05:59.874049 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:05:59.955050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:05:59.963781 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dde6a080-dfa3-407b-8832-15e6044763c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1284 microversion: 2.1 time: 0.103661 Aug 07 11:05:59.964489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 563/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:05:59 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:00.985567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:00.986247 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:00.993427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:00.993918 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:00.994356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:00.995092 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:00.995552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:00.996003 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:01.157321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-40c5eb3e-59af-43db-a923-8179da076384 req-005651a2-7fbe-40d2-8967-28f52a5624ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a44b70-9d04-4244-b535-bf63c0923329", "tag": "526c6535-dad0-4bdc-95c1-b6fa8fd109fa"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:01.168578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-40c5eb3e-59af-43db-a923-8179da076384 req-005651a2-7fbe-40d2-8967-28f52a5624ad service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:01.169057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-40c5eb3e-59af-43db-a923-8179da076384 req-005651a2-7fbe-40d2-8967-28f52a5624ad service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:01.169489 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-40c5eb3e-59af-43db-a923-8179da076384 req-005651a2-7fbe-40d2-8967-28f52a5624ad service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:01.180588 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-40c5eb3e-59af-43db-a923-8179da076384 req-005651a2-7fbe-40d2-8967-28f52a5624ad service nova] Creating event network-changed:526c6535-dad0-4bdc-95c1-b6fa8fd109fa for instance 50a44b70-9d04-4244-b535-bf63c0923329 on hv-cinder-85032 Aug 07 11:06:01.185491 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-40c5eb3e-59af-43db-a923-8179da076384 req-005651a2-7fbe-40d2-8967-28f52a5624ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032145 Aug 07 11:06:01.186279 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 564/1141] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:06:01.202219 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:01.211832 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-595e220c-d4d8-4437-aca7-9e237955efcc tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1314 microversion: 2.1 time: 0.230418 Aug 07 11:06:01.212536 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 578/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:00 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:02.234771 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:02.235506 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:02.242292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:02.242897 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:02.243487 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:02.244293 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:02.244956 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:02.245420 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:02.379610 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:02.387516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-011cff58-78d2-402b-8d0c-f150e80e5258 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1314 microversion: 2.1 time: 0.157539 Aug 07 11:06:02.388226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 565/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:02 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:03.408474 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:03.409105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:03.416884 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:03.417372 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:03.417813 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:03.418544 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:03.419090 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:03.419507 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:03.562430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:03.571294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e821c025-557f-4745-9d7c-e6298c6ec4a0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1314 microversion: 2.1 time: 0.166735 Aug 07 11:06:03.571885 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 579/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:03 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:04.592818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:04.593450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:04.600226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:04.600700 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:04.601126 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:04.601809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:04.602260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:04.602673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:04.730517 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:04.738916 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a4d0d988-cb1c-4de5-8217-e167f039558b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1314 microversion: 2.1 time: 0.150021 Aug 07 11:06:04.739503 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 566/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:04 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:05.760120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:05.760820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:05.767217 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:05.767701 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:05.768159 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:05.769071 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:05.769509 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:05.769940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:05.902667 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-cf708e8a-8642-4096-ab73-ad8bf2125a57 req-ec928062-09f7-47ba-b2a7-155f49de272d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a44b70-9d04-4244-b535-bf63c0923329", "name": "network-vif-plugged", "status": "completed", "tag": "526c6535-dad0-4bdc-95c1-b6fa8fd109fa"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:05.903212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:05.911714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b6380df3-19d5-410d-86b5-1e281f466751 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1314 microversion: 2.1 time: 0.155488 Aug 07 11:06:05.912594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 580/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:05 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:05.914504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-cf708e8a-8642-4096-ab73-ad8bf2125a57 req-ec928062-09f7-47ba-b2a7-155f49de272d service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:05.915009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-cf708e8a-8642-4096-ab73-ad8bf2125a57 req-ec928062-09f7-47ba-b2a7-155f49de272d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:05.915614 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-cf708e8a-8642-4096-ab73-ad8bf2125a57 req-ec928062-09f7-47ba-b2a7-155f49de272d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:05.927305 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-cf708e8a-8642-4096-ab73-ad8bf2125a57 req-ec928062-09f7-47ba-b2a7-155f49de272d service nova] Creating event network-vif-plugged:526c6535-dad0-4bdc-95c1-b6fa8fd109fa for instance 50a44b70-9d04-4244-b535-bf63c0923329 on hv-cinder-85032 Aug 07 11:06:05.932253 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-cf708e8a-8642-4096-ab73-ad8bf2125a57 req-ec928062-09f7-47ba-b2a7-155f49de272d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033305 Aug 07 11:06:05.932836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 567/1147] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:06:06.932455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:06.933061 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:06.939177 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:06.939662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:06.940105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:06.940796 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:06.941257 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:06.941809 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:07.071174 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:07.078672 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e3bd8cb8-619f-42c6-974f-05f05daa55ce tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1314 microversion: 2.1 time: 0.150111 Aug 07 11:06:07.079272 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 581/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:06 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:08.100672 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:08.101414 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:08.108089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:08.108577 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:08.109282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:08.110003 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:08.110465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:08.110893 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:08.246233 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:08.253602 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d079d135-25e5-4b11-aa2a-6d679ff96c4c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1498 microversion: 2.1 time: 0.157353 Aug 07 11:06:08.254935 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 568/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:08 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:08.733563 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:08.734361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:08.741130 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:08.741600 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:08.742031 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:08.742709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:08.743206 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:08.743605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:08.768053 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:06:08.839726 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:08.842271 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3e12e617-9791-4c91-9d46-05afc89b8b73 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "DELETE /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 204 len: 0 microversion: 2.1 time: 0.112267 Aug 07 11:06:08.842857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 582/1150] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:06:08 2022] DELETE /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:06:08.851843 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:08.852483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:08.854395 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:08.855097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:08.860886 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:08.861365 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:08.861796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:08.862482 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:08.863004 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:08.863981 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:08.990095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:08.997427 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d2eb04b5-cd74-4e14-a72a-44feed258066 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1504 microversion: 2.1 time: 0.150215 Aug 07 11:06:08.997979 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 569/1151] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:08 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:10.017969 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:10.018664 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:10.025579 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:10.026055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:10.026484 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:10.027190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:10.027649 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:10.028065 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:10.159970 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:10.168766 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-117d2543-f31b-4ef0-9a68-63c2641118a7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1504 microversion: 2.1 time: 0.154892 Aug 07 11:06:10.169310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 583/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:10 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:10.960993 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-ff4bcae5-db53-4b4b-8d12-49eb48f5df61 req-3932824d-4287-411e-9bb2-382db3eecd03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a44b70-9d04-4244-b535-bf63c0923329", "name": "network-vif-deleted", "tag": "526c6535-dad0-4bdc-95c1-b6fa8fd109fa"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:10.971643 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ff4bcae5-db53-4b4b-8d12-49eb48f5df61 req-3932824d-4287-411e-9bb2-382db3eecd03 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:10.972146 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ff4bcae5-db53-4b4b-8d12-49eb48f5df61 req-3932824d-4287-411e-9bb2-382db3eecd03 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:10.972567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ff4bcae5-db53-4b4b-8d12-49eb48f5df61 req-3932824d-4287-411e-9bb2-382db3eecd03 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:10.984423 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-ff4bcae5-db53-4b4b-8d12-49eb48f5df61 req-3932824d-4287-411e-9bb2-382db3eecd03 service nova] Creating event network-vif-deleted:526c6535-dad0-4bdc-95c1-b6fa8fd109fa for instance 50a44b70-9d04-4244-b535-bf63c0923329 on hv-cinder-85032 Aug 07 11:06:10.989766 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-ff4bcae5-db53-4b4b-8d12-49eb48f5df61 req-3932824d-4287-411e-9bb2-382db3eecd03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033476 Aug 07 11:06:10.990348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 570/1153] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:06:11.189594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:11.190199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:11.197311 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:11.197795 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:11.198224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:11.198911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:11.199380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:11.199804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:11.229834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:11.230304 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:11.230732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:11.231193 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lazy-loading 'fault' on Instance uuid 50a44b70-9d04-4244-b535-bf63c0923329 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:06:11.274875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:11.282372 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-29c98b3b-3bb8-43cf-bf3f-d90ca25760c0 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 200 len: 1304 microversion: 2.1 time: 0.096640 Aug 07 11:06:11.282942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 584/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:11 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:12.305193 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:12.305886 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 50a44b70-9d04-4244-b535-bf63c0923329] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:12.312056 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:12.312526 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:12.312958 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:12.313681 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:12.314089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:12.314508 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:12.327294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] HTTP exception thrown: Instance 50a44b70-9d04-4244-b535-bf63c0923329 could not be found. Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Request method failure captured: Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 HTTP/1.1 Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75yTZxiVyRRplPf_s3vl9V1T60S28j-ypa821sAn9ibgd8CPoIHxtjnQncIH1k-e5S4Wx3HvH0Upym0j2ftgndVqRs15pvQOggT1vtUhdYLAMNBB662a9jutcJ13HKSAKCPLFwQIyh0MQ6wARTrvfdgZ3e31d5POwEg30D4IbVJdOLw Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 4867894c8e5840c198d233005521fd99 Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesActionsTest-787274142 Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:06:12.328895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4867894c8e5840c198d233005521fd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4867894c8e5840c198d233005521fd99", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4867894c8e5840c198d233005521fd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4867894c8e5840c198d233005521fd99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesActionsTest-787274142 Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 4867894c8e5840c198d233005521fd99 Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesActionsTest-787274142 Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesActionsTest-787274142-project Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: c8d7c5d4a1634a71bad9102577bef117 Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesActionsTest-787274142-project Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 50a44b70-9d04-4244-b535-bf63c0923329 could not be found. Aug 07 11:06:12.330549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '50a44b70-9d04-4244-b535-bf63c0923329'} Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a44b70-9d04-4244-b535-bf63c0923329 could not be found. Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:12.331750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a44b70-9d04-4244-b535-bf63c0923329 could not be found. Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a44b70-9d04-4244-b535-bf63c0923329 could not be found. Aug 07 11:06:12.333409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:12.334619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Returning 404 to user: Instance 50a44b70-9d04-4244-b535-bf63c0923329 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:12.334619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-90c7636a-677c-4354-b333-f34da61f6e61 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329" status: 404 len: 111 microversion: 2.1 time: 0.030432 Aug 07 11:06:12.334619 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 571/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:12 2022] GET /compute/v2.1/servers/50a44b70-9d04-4244-b535-bf63c0923329 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:12.432614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1825762095", "imageRef": "6b31f6d1-cf04-4b31-b91a-59df106250ea", "flavorRef": "452", "networks": [{"uuid": "87ed2e4f-2452-4de0-8db6-8b2b93bc2c6d"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:12.484485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] validate_networks() for [('87ed2e4f-2452-4de0-8db6-8b2b93bc2c6d', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:06:12.822116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:06:12.822566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:06:12.823064 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:06:12.823500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:06:12.823906 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:06:12.832487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:12.832959 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:12.833391 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:12.834759 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:12.835233 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:12.835652 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:12.852594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Getting quotas for project 4867894c8e5840c198d233005521fd99. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:06:12.856471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Getting quotas for user c8d7c5d4a1634a71bad9102577bef117 and project 4867894c8e5840c198d233005521fd99. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:06:12.867587 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:06:12.869810 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b31f6d1-cf04-4b31-b91a-59df106250ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:06:12.916232 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-01a5a593-b214-4fd9-8f49-ee0a69ae963c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487413 Aug 07 11:06:12.916877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 585/1156] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 11:06:12.927436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-af11a8ee-396d-43b8-a8a8-129479deab00 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:12.928373 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-af11a8ee-396d-43b8-a8a8-129479deab00 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:12.985732 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-af11a8ee-396d-43b8-a8a8-129479deab00 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:12.992453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-af11a8ee-396d-43b8-a8a8-129479deab00 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1214 microversion: 2.1 time: 0.068842 Aug 07 11:06:12.993011 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 572/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:12 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:14.014121 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:14.015284 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:14.022541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:14.023152 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:14.023655 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:14.024421 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:14.024939 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:14.025436 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:14.093153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:14.101190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eca1e770-2494-4605-a3ee-fe843fff463c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1272 microversion: 2.1 time: 0.091393 Aug 07 11:06:14.101764 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 586/1158] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:14 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:15.122101 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:15.122712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:15.129400 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:15.129902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:15.136211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:15.137640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:15.138548 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:15.139032 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:15.151605 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e688c087-b6e8-4265-8a39-1e2fa608a476 req-ef1713e8-d73e-434c-a2ca-a06b1753d8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc59823-5e33-49ee-ba5e-edcf0022d40b", "tag": "625f6295-47dc-404f-aa2a-d61decd66fa0"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:15.165021 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e688c087-b6e8-4265-8a39-1e2fa608a476 req-ef1713e8-d73e-434c-a2ca-a06b1753d8e7 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:15.165647 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e688c087-b6e8-4265-8a39-1e2fa608a476 req-ef1713e8-d73e-434c-a2ca-a06b1753d8e7 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:15.166198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e688c087-b6e8-4265-8a39-1e2fa608a476 req-ef1713e8-d73e-434c-a2ca-a06b1753d8e7 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:15.180641 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e688c087-b6e8-4265-8a39-1e2fa608a476 req-ef1713e8-d73e-434c-a2ca-a06b1753d8e7 service nova] Creating event network-changed:625f6295-47dc-404f-aa2a-d61decd66fa0 for instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b on hv-cinder-85032 Aug 07 11:06:15.185683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e688c087-b6e8-4265-8a39-1e2fa608a476 req-ef1713e8-d73e-434c-a2ca-a06b1753d8e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039577 Aug 07 11:06:15.186662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 587/1159] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:06:15.622733 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:15.631347 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f8cb0ea4-f9e0-43db-9bc9-eded6bec7a15 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1314 microversion: 2.1 time: 0.512816 Aug 07 11:06:15.632824 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 573/1160] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:15 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:16.654288 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:16.654998 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:16.661623 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:16.662863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:16.663321 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:16.664003 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:16.664454 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:16.664873 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:16.794772 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:16.802191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9f6632e0-1248-480d-9717-da13dde99ea7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1314 microversion: 2.1 time: 0.152078 Aug 07 11:06:16.802774 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 588/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:16 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:17.822738 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:17.823456 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:17.829801 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:17.830275 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:17.830704 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:17.831422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:17.831875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:17.832292 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:18.036112 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:18.043569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-197a2729-d470-45d5-a5ff-a3425b94217c tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1314 microversion: 2.1 time: 0.224951 Aug 07 11:06:18.044501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 574/1162] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:17 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:19.064842 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:19.065449 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:19.072644 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:19.073317 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:19.074156 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:19.075081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:19.075597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:19.076015 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:19.210351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:19.218464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-db51bb71-2dc8-409a-865c-f51c75796690 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1314 microversion: 2.1 time: 0.158204 Aug 07 11:06:19.219228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 589/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:19 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:20.240777 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:20.241305 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:20.247763 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:20.248244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:20.248676 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:20.249355 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:20.249811 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:20.250235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:20.377875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:20.386093 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b54705d2-6a1c-4636-a55a-ffc455a6f5c2 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1314 microversion: 2.1 time: 0.149860 Aug 07 11:06:20.386661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 575/1164] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:20 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:21.406243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:21.406850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:21.413609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:21.414091 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:21.414522 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:21.415243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:21.415693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:21.416112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:21.547339 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:21.555234 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e14e21f-b876-4ba5-abee-47a69ea6fc33 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1314 microversion: 2.1 time: 0.152789 Aug 07 11:06:21.555804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 590/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:21 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:21.960869 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-be3749fd-7df4-4e72-b7ce-d265bf880a0a req-5d0d7250-bd26-461b-a65e-ea18cfa697a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc59823-5e33-49ee-ba5e-edcf0022d40b", "name": "network-vif-plugged", "status": "completed", "tag": "625f6295-47dc-404f-aa2a-d61decd66fa0"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:21.972312 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-be3749fd-7df4-4e72-b7ce-d265bf880a0a req-5d0d7250-bd26-461b-a65e-ea18cfa697a1 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:21.973024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-be3749fd-7df4-4e72-b7ce-d265bf880a0a req-5d0d7250-bd26-461b-a65e-ea18cfa697a1 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:21.973453 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-be3749fd-7df4-4e72-b7ce-d265bf880a0a req-5d0d7250-bd26-461b-a65e-ea18cfa697a1 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:21.985042 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-be3749fd-7df4-4e72-b7ce-d265bf880a0a req-5d0d7250-bd26-461b-a65e-ea18cfa697a1 service nova] Creating event network-vif-plugged:625f6295-47dc-404f-aa2a-d61decd66fa0 for instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b on hv-cinder-85032 Aug 07 11:06:21.990985 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-be3749fd-7df4-4e72-b7ce-d265bf880a0a req-5d0d7250-bd26-461b-a65e-ea18cfa697a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033546 Aug 07 11:06:21.991581 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 576/1166] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:06:22.576514 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:22.577121 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:22.583977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:22.584457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:22.584879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:22.585556 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:22.586006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:22.586423 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:22.711708 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:22.719289 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d8c7f20d-a2ec-44e2-8aa5-7bfc054a3365 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1314 microversion: 2.1 time: 0.146541 Aug 07 11:06:22.719863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 591/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:22 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:23.742019 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:23.742640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:23.745131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:23.750658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:23.751169 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:23.751610 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:23.752304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:23.752763 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:23.753189 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:23.885585 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:23.893106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6549ed08-b9fa-4d7b-b4dd-f3591617ab50 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1498 microversion: 2.1 time: 0.156002 Aug 07 11:06:23.893661 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 577/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:23 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:24.429353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:24.429909 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:24.431882 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:24.432722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:24.439310 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:24.439804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:24.440244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:24.440943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:24.441404 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:24.441872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:24.468186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:06:24.501520 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:24.544014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-aa7fabb9-91a4-4d9c-ae11-525493720f83 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 204 len: 0 microversion: 2.1 time: 0.118526 Aug 07 11:06:24.544737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 592/1169] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:06:24 2022] DELETE /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:06:24.553230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:24.553825 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:24.559897 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:24.560372 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:24.560918 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:24.561599 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:24.562085 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:24.562506 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:24.694830 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:24.702217 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3823e61e-77a6-4727-947b-45ec820675b7 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1504 microversion: 2.1 time: 0.153041 Aug 07 11:06:24.702808 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 578/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:24 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:06:25.723332 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:25.724819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:25.731230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:25.731709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:25.732135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:25.732819 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:25.733268 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:25.733695 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:25.869140 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:25.877309 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1fea56cd-3bfd-4389-9200-cf28547e0144 tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1504 microversion: 2.1 time: 0.158428 Aug 07 11:06:25.877886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 593/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:25 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:26.796192 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-0d485502-19a5-47b0-88a4-19f4ef9fb1ba req-725e62bc-b824-43ca-9323-74f5be5fcdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc59823-5e33-49ee-ba5e-edcf0022d40b", "name": "network-vif-deleted", "tag": "625f6295-47dc-404f-aa2a-d61decd66fa0"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:26.808639 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0d485502-19a5-47b0-88a4-19f4ef9fb1ba req-725e62bc-b824-43ca-9323-74f5be5fcdae service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:26.809875 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0d485502-19a5-47b0-88a4-19f4ef9fb1ba req-725e62bc-b824-43ca-9323-74f5be5fcdae service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:26.810380 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0d485502-19a5-47b0-88a4-19f4ef9fb1ba req-725e62bc-b824-43ca-9323-74f5be5fcdae service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:26.823143 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-0d485502-19a5-47b0-88a4-19f4ef9fb1ba req-725e62bc-b824-43ca-9323-74f5be5fcdae service nova] Creating event network-vif-deleted:625f6295-47dc-404f-aa2a-d61decd66fa0 for instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b on hv-cinder-85032 Aug 07 11:06:26.829507 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-0d485502-19a5-47b0-88a4-19f4ef9fb1ba req-725e62bc-b824-43ca-9323-74f5be5fcdae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037893 Aug 07 11:06:26.830092 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 579/1172] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:06:26.898822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:26.899597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:26.906347 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:26.906821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:26.907891 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:26.908594 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:26.909041 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:26.909457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:26.942078 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:26.944762 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:26.945221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:26.945676 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lazy-loading 'fault' on Instance uuid 8bc59823-5e33-49ee-ba5e-edcf0022d40b {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:06:26.991172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d7c5d4a1634a71bad9102577bef117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4867894c8e5840c198d233005521fd99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:26.998952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73917824-355f-42fd-991a-c0d76ce666ac tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 200 len: 1304 microversion: 2.1 time: 0.104772 Aug 07 11:06:26.999533 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 594/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:26 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:28.019960 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:28.020716 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] [instance: 8bc59823-5e33-49ee-ba5e-edcf0022d40b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:28.023143 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:28.028429 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:28.028901 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:28.029342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:28.030009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:28.030457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:28.030876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:28.034059 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=75 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:28.045809 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] HTTP exception thrown: Instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b could not be found. Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Request method failure captured: Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b HTTP/1.1 Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75yTZxiVyRRplPf_s3vl9V1T60S28j-ypa821sAn9ibgd8CPoIHxtjnQncIH1k-e5S4Wx3HvH0Upym0j2ftgndVqRs15pvQOggT1vtUhdYLAMNBB662a9jutcJ13HKSAKCPLFwQIyh0MQ6wARTrvfdgZ3e31d5POwEg30D4IbVJdOLw Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 4867894c8e5840c198d233005521fd99 Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesActionsTest-787274142 Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:06:28.047504 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4867894c8e5840c198d233005521fd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4867894c8e5840c198d233005521fd99", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4867894c8e5840c198d233005521fd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4867894c8e5840c198d233005521fd99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesActionsTest-787274142 Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 4867894c8e5840c198d233005521fd99 Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesActionsTest-787274142 Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesActionsTest-787274142-project Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: c8d7c5d4a1634a71bad9102577bef117 Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesActionsTest-787274142-project Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b could not be found. Aug 07 11:06:28.049103 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '8bc59823-5e33-49ee-ba5e-edcf0022d40b'} Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b could not be found. Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:28.049957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b could not be found. Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b could not be found. Aug 07 11:06:28.051492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:28.053379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] Returning 404 to user: Instance 8bc59823-5e33-49ee-ba5e-edcf0022d40b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:28.053379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f5a12d5f-72c8-4bcb-9ab2-c3d428a4307b tempest-VolumesActionsTest-787274142 tempest-VolumesActionsTest-787274142-project] 10.222.0.25 "GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b" status: 404 len: 111 microversion: 2.1 time: 0.033074 Aug 07 11:06:28.053379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 580/1174] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:28 2022] GET /compute/v2.1/servers/8bc59823-5e33-49ee-ba5e-edcf0022d40b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:28.277481 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:28.278035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:28.284627 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:28.285188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:28.285724 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:28.287426 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:28.287991 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:28.288557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:28.313378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5943dfef-441a-4c9c-ad27-fdee2a6653c5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/ips" status: 200 len: 148 microversion: 2.1 time: 0.039836 Aug 07 11:06:28.314048 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 595/1175] 10.222.0.25 () {58 vars in 1248 bytes} [Sun Aug 7 11:06:28 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:06:29.649674 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbb8a6a7-f3a8-4131-b34d-fb0da710481b"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:29.652058 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:29.658361 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:29.658842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:29.659314 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:29.660008 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:29.660465 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:29.660891 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:33.053301 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3c6e49e2-c3f1-42f2-ab3a-db25d7a09542 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "POST /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.408104 Aug 07 11:06:33.053950 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 581/1176] 10.222.0.25 () {60 vars in 1323 bytes} [Sun Aug 7 11:06:29 2022] POST /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments => generated 194 bytes in 3410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:06:41.824977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:41.825927 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:41.832555 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:41.834221 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:41.836448 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:41.837291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:41.837827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:41.838651 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:41.839236 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:41.839776 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:41.940593 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lazy-loading 'services' on Instance uuid 2c62cc39-5dc6-486f-803f-b0ad90bdab4b {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:06:42.027287 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-74f36f5f-bd7f-4f49-b31e-72aaf7177b50 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments/fbb8a6a7-f3a8-4131-b34d-fb0da710481b" status: 202 len: 0 microversion: 2.1 time: 0.209138 Aug 07 11:06:42.028216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 596/1177] 10.222.0.25 () {58 vars in 1416 bytes} [Sun Aug 7 11:06:41 2022] DELETE /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments/fbb8a6a7-f3a8-4131-b34d-fb0da710481b => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:06:42.035636 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:42.041947 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:42.044441 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:42.051886 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:42.052650 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:42.053102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:42.053896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:42.054434 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:42.054949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:42.088907 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e26da493-a282-4768-8492-86d01474377a tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054897 Aug 07 11:06:42.089472 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 582/1178] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:06:42 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:06:43.102870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:43.106291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:43.114662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:43.115181 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:43.115614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:43.116412 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:43.116866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:43.117282 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:43.150604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-70f88318-bf76-4e02-86c0-7f9b85ea0cc2 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052518 Aug 07 11:06:43.151212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 597/1179] 10.222.0.25 () {58 vars in 1302 bytes} [Sun Aug 7 11:06:43 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 11:06:43.223575 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:43.224298 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:43.231258 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:43.232034 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:43.232698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:43.233592 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:43.234469 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:43.235084 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:43.264081 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:06:43.359765 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1bc80618-5f73-4d55-b970-36c74466442d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 204 len: 0 microversion: 2.1 time: 0.139421 Aug 07 11:06:43.363061 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 583/1180] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:06:43 2022] DELETE /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 11:06:43.369785 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:43.370411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:43.376792 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:43.377673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:43.378112 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:43.378805 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:43.379305 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:43.380016 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:43.549318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:43.562403 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1fed4300-4673-4bd5-a360-8c1b8cc20718 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1680 microversion: 2.1 time: 0.196817 Aug 07 11:06:43.563218 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 598/1181] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:43 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:44.588322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:44.590152 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:44.598237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:44.599658 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:44.600350 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:44.601131 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:44.601657 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:44.602342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:44.761123 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:44.774846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-907632ba-e21d-478e-bb32-443f16a67a7d tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1680 microversion: 2.1 time: 0.192708 Aug 07 11:06:44.775769 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 584/1182] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:44 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:45.802172 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:45.803107 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:45.810845 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:45.812099 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:45.812827 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:45.815215 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:45.816438 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:45.818173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:46.045341 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:46.061470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8bfb9dbf-52df-4a35-accc-2ae669211a92 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1680 microversion: 2.1 time: 0.263914 Aug 07 11:06:46.063222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 599/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:45 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:46.790600 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-9b5b7e3b-70ed-4879-8a93-890767963846 req-dedf0f7a-ee67-4efa-ad8d-a1def1c2868e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c62cc39-5dc6-486f-803f-b0ad90bdab4b", "name": "network-vif-deleted", "tag": "2cb920cb-2098-4b63-be44-544d05e3433c"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:06:46.811095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-9b5b7e3b-70ed-4879-8a93-890767963846 req-dedf0f7a-ee67-4efa-ad8d-a1def1c2868e service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:46.811556 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-9b5b7e3b-70ed-4879-8a93-890767963846 req-dedf0f7a-ee67-4efa-ad8d-a1def1c2868e service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:46.813224 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-9b5b7e3b-70ed-4879-8a93-890767963846 req-dedf0f7a-ee67-4efa-ad8d-a1def1c2868e service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:46.845328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-9b5b7e3b-70ed-4879-8a93-890767963846 req-dedf0f7a-ee67-4efa-ad8d-a1def1c2868e service nova] Creating event network-vif-deleted:2cb920cb-2098-4b63-be44-544d05e3433c for instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b on hv-cinder-85032 Aug 07 11:06:46.859255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-9b5b7e3b-70ed-4879-8a93-890767963846 req-dedf0f7a-ee67-4efa-ad8d-a1def1c2868e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071191 Aug 07 11:06:46.861911 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 585/1184] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:06:47.086538 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:47.087775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:47.094690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:47.095440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:47.096062 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:47.096927 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:47.097536 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:47.098128 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:47.134486 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:47.136498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:47.137135 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:47.137868 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lazy-loading 'fault' on Instance uuid 2c62cc39-5dc6-486f-803f-b0ad90bdab4b {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:06:47.187696 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06231f178e0d494084915b9368fa3b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01328619d6b24d359c0352ef4119ea90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:06:47.197078 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-61de32ee-e6c5-4c03-8ada-ab539c943135 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 200 len: 1332 microversion: 2.1 time: 0.115233 Aug 07 11:06:47.210733 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 600/1185] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:47 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:06:48.218563 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:48.221672 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:48.233438 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:48.234756 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:48.235318 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:48.240620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:48.240620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:48.242816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:48.267683 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b HTTP/1.1 Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:06:48.270077 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:48.274670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '2c62cc39-5dc6-486f-803f-b0ad90bdab4b'} Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:48.278529 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:48.280228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:48.282018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:48.282018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a71768e5-29f7-472b-988a-7614493b3568 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 404 len: 111 microversion: 2.1 time: 0.056463 Aug 07 11:06:48.282018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 586/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:48 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:48.282351 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-289fdf95-6f34-4afd-9594-16f892b4f8d0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '.version_select at 0x7fc5ed7c5310>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:48.299014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-289fdf95-6f34-4afd-9594-16f892b4f8d0 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077363857" status: 202 len: 0 microversion: 2.1 time: 0.022438 Aug 07 11:06:48.299597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 601/1187] 10.222.0.25 () {58 vars in 1221 bytes} [Sun Aug 7 11:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077363857 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:06:50.185717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:50.186226 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:50.193359 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:50.193835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:50.194263 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:50.194957 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:50.195406 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:50.195821 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:50.208996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b HTTP/1.1 Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:06:50.210541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.212203 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '2c62cc39-5dc6-486f-803f-b0ad90bdab4b'} Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:50.213316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.214796 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.217065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:50.217065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6437caa8-69d6-42b4-aa63-2fa9678c66cd tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 404 len: 111 microversion: 2.1 time: 0.030211 Aug 07 11:06:50.217065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 587/1188] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:06:50 2022] DELETE /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:50.221027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:50.221669 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 2c62cc39-5dc6-486f-803f-b0ad90bdab4b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:50.229968 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:50.230448 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:50.230884 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:50.231599 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:50.232055 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:50.232480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:50.246106 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b HTTP/1.1 Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:06:50.247770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.249363 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '2c62cc39-5dc6-486f-803f-b0ad90bdab4b'} Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:50.250455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. Aug 07 11:06:50.251995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:50.253431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 2c62cc39-5dc6-486f-803f-b0ad90bdab4b could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:50.253431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9f0a4872-568a-453d-a896-b486c6393337 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b" status: 404 len: 111 microversion: 2.1 time: 0.032743 Aug 07 11:06:50.253431 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 602/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:50 2022] GET /compute/v2.1/servers/2c62cc39-5dc6-486f-803f-b0ad90bdab4b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:51.556328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:51.556817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:51.563198 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.563675 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.564106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.564793 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.565244 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.565665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.579626 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b HTTP/1.1 Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:06:51.581158 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.582742 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '62ce0c19-1f84-4341-926f-d60fb8e0273b'} Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:51.584332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.585826 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.587324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:51.587324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7661206a-8150-42f0-b4cb-b368984526d5 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 404 len: 111 microversion: 2.1 time: 0.030405 Aug 07 11:06:51.587324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 588/1190] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:06:51 2022] DELETE /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:51.591551 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:51.592192 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 62ce0c19-1f84-4341-926f-d60fb8e0273b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:51.598609 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.599136 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.599570 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.601414 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.601870 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.602294 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.616638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b HTTP/1.1 Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:06:51.618101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.619834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '62ce0c19-1f84-4341-926f-d60fb8e0273b'} Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:51.620732 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. Aug 07 11:06:51.622262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.623750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 62ce0c19-1f84-4341-926f-d60fb8e0273b could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:51.623750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b96ef170-0f38-4a6f-821b-d6924da1bb1e tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b" status: 404 len: 111 microversion: 2.1 time: 0.031810 Aug 07 11:06:51.623750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 603/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:51 2022] GET /compute/v2.1/servers/62ce0c19-1f84-4341-926f-d60fb8e0273b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 11:06:51.627828 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:51.628332 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:51.634941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.635433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.635869 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.636561 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.637021 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.637450 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.650492 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd HTTP/1.1 Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:06:51.652057 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.653649 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '5389db54-ca87-4ac8-878c-08eddf5676dd'} Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:51.654567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.656055 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.657470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:51.657470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0cc744d3-0d6e-49c2-a609-c1d2d4ffe8fc tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 404 len: 111 microversion: 2.1 time: 0.029451 Aug 07 11:06:51.657470 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 589/1192] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:06:51 2022] DELETE /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 11:06:51.661888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:51.662496 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 5389db54-ca87-4ac8-878c-08eddf5676dd] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:51.668368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.668843 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.669280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.669965 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:51.670418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:51.670839 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:51.684485 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd HTTP/1.1 Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:06:51.685972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.687569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '5389db54-ca87-4ac8-878c-08eddf5676dd'} Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:51.688405 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. Aug 07 11:06:51.689872 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:51.691182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 5389db54-ca87-4ac8-878c-08eddf5676dd could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:51.691182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-93bbffac-ac38-48f8-be3f-931372c6beef tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd" status: 404 len: 111 microversion: 2.1 time: 0.029380 Aug 07 11:06:51.691182 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 604/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:51 2022] GET /compute/v2.1/servers/5389db54-ca87-4ac8-878c-08eddf5676dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:52.824605 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:52.825289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:52.832729 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:52.833915 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:52.834355 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:52.835109 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:52.835560 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:52.835975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:52.849773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c HTTP/1.1 Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:06:52.851360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.853047 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '71bde61e-a4b4-4a6c-87dc-23390b24133c'} Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:52.854155 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.855651 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.857256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:52.857256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c2286ae0-de46-402a-a616-87cd9ea191c3 tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 404 len: 111 microversion: 2.1 time: 0.031986 Aug 07 11:06:52.857256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 590/1194] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:06:52 2022] DELETE /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:06:52.861616 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:06:52.862225 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] [instance: 71bde61e-a4b4-4a6c-87dc-23390b24133c] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:06:52.868671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:52.869154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:52.869577 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:52.870262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:06:52.870719 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:06:52.871139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:06:52.887147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] HTTP exception thrown: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Request method failure captured: Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c HTTP/1.1 Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75ppXZDTm3oXku_ty-_GrezBE_-N6dxlxnbdd0FvlGJw2P3ykqf0qu2agAWXovVbzAGeQoMYISHDKdHI1RNsyZkS2RohKQnntm2MUEMUTAJWOM_EjSMu0XcvX4Nq1aY103hD1LdpZ-IcGt-mqiFkZGRjaWsZmjRmokhZB-Xc-5AlGC8 Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:06:52.888737 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01328619d6b24d359c0352ef4119ea90", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01328619d6b24d359c0352ef4119ea90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 01328619d6b24d359c0352ef4119ea90 Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1630907383 Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 06231f178e0d494084915b9368fa3b9b Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-1630907383-project Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.890388 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '71bde61e-a4b4-4a6c-87dc-23390b24133c'} Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:06:52.895005 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. Aug 07 11:06:52.898110 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:06:52.899444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] Returning 404 to user: Instance 71bde61e-a4b4-4a6c-87dc-23390b24133c could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:06:52.899444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-682a3f21-bae9-45f5-91f8-fdbcf3eef6ca tempest-AttachVolumeNegativeTest-1630907383 tempest-AttachVolumeNegativeTest-1630907383-project] 10.222.0.25 "GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c" status: 404 len: 111 microversion: 2.1 time: 0.032655 Aug 07 11:06:52.899444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 605/1195] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:06:52 2022] GET /compute/v2.1/servers/71bde61e-a4b4-4a6c-87dc-23390b24133c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:07:34.155986 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:34.157157 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:34.340689 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-67505b29-d85f-4af4-a3d4-65cf325668a9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Action: 'create', calling method: .version_select at 0x7fc5eda55d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1484629655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWzJERLS3b9Uw3VMaicOM6Z3aYoO+I8QxnRSIvYF51Tyr4/2DjZW2qN6TBhHn/ed752wfgYtHMu7yOcQq3noyyotJtjjK/tlNVK6q2E/+BkSuaKQiL3KL/dOAkZbSXqHQ=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:07:34.356067 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-67505b29-d85f-4af4-a3d4-65cf325668a9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for project a100e5012adf44d793aac8838ec5b120. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:07:34.360177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-67505b29-d85f-4af4-a3d4-65cf325668a9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for user 0957d7b6060648bca681160dcbc731e8 and project a100e5012adf44d793aac8838ec5b120. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:07:34.372885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR oslo.messaging._drivers.impl_rabbit [None req-67505b29-d85f-4af4-a3d4-65cf325668a9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [07787a9a-b0a5-4043-8e76-40744053a759] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 11:07:35.380677 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [None req-67505b29-d85f-4af4-a3d4-65cf325668a9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [07787a9a-b0a5-4043-8e76-40744053a759] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38154. Aug 07 11:07:35.395320 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-67505b29-d85f-4af4-a3d4-65cf325668a9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.244554 Aug 07 11:07:35.395914 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 591/1196] 10.222.0.25 () {60 vars in 1159 bytes} [Sun Aug 7 11:07:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:07:56.933291 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:56.934028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:56.938525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-987650912", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1484629655", "security_groups": [{"name": "tempest-secgroup-smoke-1686257402"}], "block_device_mapping_v2": [{"uuid": "f1accb37-8162-4076-b2ed-9c065f26d189", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "92e2a885-c31d-4a1a-9780-2bc64b83e6ec"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:07:57.052387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] validate_networks() for [('92e2a885-c31d-4a1a-9780-2bc64b83e6ec', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:07:57.415471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:07:57.415902 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:07:57.416411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:07:57.416821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:07:57.417368 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:07:57.426455 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:07:57.426937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:07:57.427495 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:07:57.428222 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:07:57.428678 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:07:57.429101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:07:57.445709 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for project a100e5012adf44d793aac8838ec5b120. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:07:57.449657 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for user 0957d7b6060648bca681160dcbc731e8 and project a100e5012adf44d793aac8838ec5b120. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:07:57.505969 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:07:57.508098 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1accb37-8162-4076-b2ed-9c065f26d189',volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:07:57.632886 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e6db86d7-871d-4b39-8260-1e56ce793f41 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701412 Aug 07 11:07:57.633533 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 606/1197] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:07:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 11:07:57.642236 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=4 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:57.643082 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:57.648327 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7b78dc38-90aa-44ed-8c4e-c4fc5668e3dd tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:07:57.649936 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7b78dc38-90aa-44ed-8c4e-c4fc5668e3dd tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:07:57.709431 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7b78dc38-90aa-44ed-8c4e-c4fc5668e3dd tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:07:57.716331 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7b78dc38-90aa-44ed-8c4e-c4fc5668e3dd tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1094 microversion: 2.1 time: 0.075377 Aug 07 11:07:57.717525 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 592/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:07:57 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:07:58.738654 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:07:58.739329 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:07:58.746755 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:07:58.747267 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:07:58.747699 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:07:58.748396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:07:58.748898 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:07:58.749318 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:07:58.839104 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:07:58.849344 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-99ad6515-489a-480a-b3af-c9dd85270947 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1210 microversion: 2.1 time: 0.116312 Aug 07 11:07:58.850164 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 607/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:07:58 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:07:59.870847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:07:59.871496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:07:59.878836 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:07:59.879372 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:07:59.879839 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:07:59.880546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:07:59.881009 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:07:59.881443 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:00.086352 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:00.094534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6f7336f7-557c-4432-8802-957e50607669 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.227493 Aug 07 11:08:00.095191 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 593/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:07:59 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:08:00.107803 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-1150f956-e395-4840-a7bf-deb6e9a3e7df req-1d6c3c58-e0e7-440a-b93d-eb7bd5c3c16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2", "tag": "10c3d4e0-6288-4666-bf2c-17656887b13b"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:08:00.124683 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1150f956-e395-4840-a7bf-deb6e9a3e7df req-1d6c3c58-e0e7-440a-b93d-eb7bd5c3c16d service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:00.125160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1150f956-e395-4840-a7bf-deb6e9a3e7df req-1d6c3c58-e0e7-440a-b93d-eb7bd5c3c16d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:00.125582 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-1150f956-e395-4840-a7bf-deb6e9a3e7df req-1d6c3c58-e0e7-440a-b93d-eb7bd5c3c16d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:00.136849 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-1150f956-e395-4840-a7bf-deb6e9a3e7df req-1d6c3c58-e0e7-440a-b93d-eb7bd5c3c16d service nova] Creating event network-changed:10c3d4e0-6288-4666-bf2c-17656887b13b for instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 on hv-cinder-85032 Aug 07 11:08:00.142139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-1150f956-e395-4840-a7bf-deb6e9a3e7df req-1d6c3c58-e0e7-440a-b93d-eb7bd5c3c16d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039482 Aug 07 11:08:00.142957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 608/1201] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:08:01.115387 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:01.116044 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:01.122393 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:01.122876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:01.123352 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:01.124827 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:01.125289 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:01.125718 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:01.258673 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:01.266276 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c43b0fce-3c1c-4d5b-9bab-51cb1cff1ac2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.154747 Aug 07 11:08:01.266842 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 594/1202] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:01 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:02.287480 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:02.288179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:02.294745 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:02.295259 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:02.296399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:02.297154 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:02.297613 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:02.298039 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:02.425383 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:02.432887 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d0d42791-3ccd-4068-8efa-346cbec8f788 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.149699 Aug 07 11:08:02.433445 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 609/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:02 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:03.453183 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:03.453798 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:03.460287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:03.460799 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:03.461234 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:03.461919 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:03.462374 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:03.462797 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:03.594730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:03.602222 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9f4687f1-16cf-4069-bf07-925566d2a99e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.152934 Aug 07 11:08:03.602790 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 595/1204] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:03 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:04.622952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:04.623569 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:04.630009 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:04.630491 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:04.630938 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:04.631628 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:04.632080 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:04.632531 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:04.761179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:04.768784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4a47a7d8-5d56-4742-a152-52cde0a3cad4 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.149662 Aug 07 11:08:04.769380 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 610/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:04 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:08:05.789343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:05.789962 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:05.796327 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:05.797315 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:05.797746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:05.798429 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:05.798884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:05.799335 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:05.931496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:05.939554 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aadf0c05-c50b-40e5-a524-fa62ec883d7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.154066 Aug 07 11:08:05.940111 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 596/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:05 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:06.960261 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:06.960878 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:06.966763 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:06.967278 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:06.967716 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:06.968402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:06.968877 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:06.969298 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:07.097122 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:07.104462 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5dc1efa3-a00e-446e-9353-b792c371c3d7 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.148186 Aug 07 11:08:07.105028 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 611/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:06 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:08.125990 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:08.126601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:08.128959 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:08:08.134173 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:08.134650 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:08.135107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:08.135786 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:08.136235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:08.136653 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:08.266237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:08.273604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bfc2b244-c7aa-4409-8b46-9d3cf7743e28 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.151619 Aug 07 11:08:08.274159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 597/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:08 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:09.293498 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:09.294142 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:09.296102 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:08:09.297627 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:08:09.304644 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:09.305131 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:09.305567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:09.306270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:09.306727 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:09.307179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:09.444212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:09.454285 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4032bec3-8201-42b7-90fb-9815748d9760 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.164559 Aug 07 11:08:09.454875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 612/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:09 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:10.473779 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:10.474396 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:10.480806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:10.481300 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:10.481739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:10.482433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:10.482892 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:10.483343 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:10.616633 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:10.624090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-905a4ee0-f232-4e44-a232-de3ddce4b103 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.154209 Aug 07 11:08:10.625177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 598/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:10 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:11.412019 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-7b72651e-ae96-4c31-afda-7356ae7ec472 req-f054174c-7b61-4b86-a522-924ebd371a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2", "name": "network-vif-plugged", "status": "completed", "tag": "10c3d4e0-6288-4666-bf2c-17656887b13b"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:08:11.420377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7b72651e-ae96-4c31-afda-7356ae7ec472 req-f054174c-7b61-4b86-a522-924ebd371a7d service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:11.421014 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7b72651e-ae96-4c31-afda-7356ae7ec472 req-f054174c-7b61-4b86-a522-924ebd371a7d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:11.422209 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7b72651e-ae96-4c31-afda-7356ae7ec472 req-f054174c-7b61-4b86-a522-924ebd371a7d service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:11.433767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-7b72651e-ae96-4c31-afda-7356ae7ec472 req-f054174c-7b61-4b86-a522-924ebd371a7d service nova] Creating event network-vif-plugged:10c3d4e0-6288-4666-bf2c-17656887b13b for instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 on hv-cinder-85032 Aug 07 11:08:11.439320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-7b72651e-ae96-4c31-afda-7356ae7ec472 req-f054174c-7b61-4b86-a522-924ebd371a7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Aug 07 11:08:11.439951 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 613/1211] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:08:11.645339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:11.645952 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:11.652402 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:11.652884 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:11.653316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:11.654012 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:11.654458 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:11.654877 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:11.815971 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:11.823401 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0c7abb34-3bad-4fdd-b725-08e11f991059 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.182166 Aug 07 11:08:11.823963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 599/1212] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:11 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:12.845322 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:12.846216 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:12.852950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:12.853426 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:12.853854 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:12.854537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:12.855021 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:12.855439 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:12.985802 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:12.993396 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6442a742-848e-406c-a910-177343a1ef4b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1266 microversion: 2.1 time: 0.152440 Aug 07 11:08:12.993950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 614/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:12 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:14.013555 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:14.014161 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:14.021206 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:14.021679 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:14.022106 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:14.022792 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:14.023269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:14.023690 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:14.158624 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:14.166159 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f78f8735-5154-47f9-a5b9-91446cc73b52 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1453 microversion: 2.1 time: 0.156475 Aug 07 11:08:14.166723 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 600/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:14 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:14.185637 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:08:14.186252 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:08:14.193555 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:14.194035 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:14.194469 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:14.195211 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:14.195671 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:14.196095 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:14.324638 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:08:14.332820 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6fc73c7a-014d-4180-a96e-dd68f06c8182 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1453 microversion: 2.1 time: 0.150976 Aug 07 11:08:14.333391 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 615/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:08:14 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:08:16.198949 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-568c2ed2-ea25-4c6c-9b73-9537d8741c5d req-0807a444-91de-438e-8466-826c27298619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2", "tag": "10c3d4e0-6288-4666-bf2c-17656887b13b"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:08:16.208806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-568c2ed2-ea25-4c6c-9b73-9537d8741c5d req-0807a444-91de-438e-8466-826c27298619 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:08:16.209271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-568c2ed2-ea25-4c6c-9b73-9537d8741c5d req-0807a444-91de-438e-8466-826c27298619 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:08:16.209693 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-568c2ed2-ea25-4c6c-9b73-9537d8741c5d req-0807a444-91de-438e-8466-826c27298619 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:08:16.221436 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-568c2ed2-ea25-4c6c-9b73-9537d8741c5d req-0807a444-91de-438e-8466-826c27298619 service nova] Creating event network-changed:10c3d4e0-6288-4666-bf2c-17656887b13b for instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 on hv-cinder-85032 Aug 07 11:08:16.227379 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-568c2ed2-ea25-4c6c-9b73-9537d8741c5d req-0807a444-91de-438e-8466-826c27298619 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031961 Aug 07 11:08:16.228201 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 601/1216] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:09:17.229990 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:09:17.230789 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:10:30.344901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:10:30.345797 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=48 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:10:30.349775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:30.350270 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:30.358009 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:30.358490 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:30.358954 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:30.359888 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:30.360353 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:30.360804 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:30.385614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:10:30.460160 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-be2152f5-4d84-4a9b-8ef0-2364cf849119 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "DELETE /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 204 len: 0 microversion: 2.1 time: 0.116915 Aug 07 11:10:30.460789 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 616/1217] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:10:30 2022] DELETE /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:10:30.468360 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8fe2ec4-667a-4335-8893-a7e5b34ab43e] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 11:10:30.469043 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=22 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:10:30.470003 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=50 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:10:30.474551 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:30.475268 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:30.482345 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:30.482845 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:30.483328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:30.483971 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:30.484418 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:30.485097 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:30.677069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:30.684523 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0d895200-554d-4d45-b9ff-92de41c3e91e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1578 microversion: 2.1 time: 0.218109 Aug 07 11:10:30.685089 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 602/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:30 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1578 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:10:31.706129 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:31.706793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:31.713284 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:31.713769 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:31.714762 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:31.715563 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:31.716023 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:31.716447 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:31.901440 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:31.909829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2bda1ae9-2864-44c1-8d14-92551cd130a1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1578 microversion: 2.1 time: 0.207971 Aug 07 11:10:31.910435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 617/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:31 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:32.932287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:32.932823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:32.944860 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:32.945717 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:32.946107 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:32.946902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:32.947405 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:32.947831 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:32.954541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8fe2ec4-667a-4335-8893-a7e5b34ab43e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38398. Aug 07 11:10:33.053176 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:33.064211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-feada689-03df-4750-a63b-0473b9aebf75 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1510 microversion: 2.1 time: 0.135911 Aug 07 11:10:33.065109 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 603/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:32 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1510 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:33.323875 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-3f922d89-556b-441d-9bd7-341144c820f4 req-ccb533a6-b623-410e-8fdc-75f5caf567f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2", "name": "network-vif-deleted", "tag": "10c3d4e0-6288-4666-bf2c-17656887b13b"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:10:33.341895 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3f922d89-556b-441d-9bd7-341144c820f4 req-ccb533a6-b623-410e-8fdc-75f5caf567f3 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:33.342574 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3f922d89-556b-441d-9bd7-341144c820f4 req-ccb533a6-b623-410e-8fdc-75f5caf567f3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:33.343031 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3f922d89-556b-441d-9bd7-341144c820f4 req-ccb533a6-b623-410e-8fdc-75f5caf567f3 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:33.358081 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-3f922d89-556b-441d-9bd7-341144c820f4 req-ccb533a6-b623-410e-8fdc-75f5caf567f3 service nova] Creating event network-vif-deleted:10c3d4e0-6288-4666-bf2c-17656887b13b for instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 on hv-cinder-85032 Aug 07 11:10:33.364170 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-3f922d89-556b-441d-9bd7-341144c820f4 req-ccb533a6-b623-410e-8fdc-75f5caf567f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118040 Aug 07 11:10:33.365171 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 618/1221] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:10:34.085823 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:34.086483 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:34.094333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:34.095124 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:34.095568 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:34.096304 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:34.096941 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:34.097372 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:34.132802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:34.133294 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:34.133735 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:34.134190 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lazy-loading 'fault' on Instance uuid 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 11:10:34.181223 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:34.189184 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e73f1760-c5b3-40c7-b6a8-bb263899c891 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 200 len: 1184 microversion: 2.1 time: 0.107249 Aug 07 11:10:34.189759 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 604/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:34 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 1184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:35.210105 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:35.210801 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:35.218371 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:35.218857 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:35.219320 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:35.220013 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:35.220470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:35.220896 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:35.234614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] HTTP exception thrown: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Request method failure captured: Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 HTTP/1.1 Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75zw5ejH284FRJebb2H6x3H7gBHqf9tnek2QL2DB8ZdzCwVKHwW96Iqj8_kUT_ZUxkXxsyOp9A2nyLDw-L4YZh3hiQFkPjcoVHpp20LTMgFj12ZXcw73E11g2LPVY4aCNnO1VoOUTRBzHhFQVrF24BQZk0fAJmUzoqxrkGyhpeWBqkw Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:10:35.236863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a100e5012adf44d793aac8838ec5b120", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 0957d7b6060648bca681160dcbc731e8 Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:10:35.238728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2'} Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:10:35.240117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:10:35.241828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:10:35.243370 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Returning 404 to user: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:10:35.243370 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-42727796-23a5-4e79-a9a0-944d6815c37a tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 404 len: 111 microversion: 2.1 time: 0.032507 Aug 07 11:10:35.243370 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 619/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:35 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:10:35.286749 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-9683183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1484629655", "security_groups": [{"name": "tempest-secgroup-smoke-1686257402"}], "block_device_mapping_v2": [{"uuid": "f1accb37-8162-4076-b2ed-9c065f26d189", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "92e2a885-c31d-4a1a-9780-2bc64b83e6ec"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:10:35.401772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] validate_networks() for [('92e2a885-c31d-4a1a-9780-2bc64b83e6ec', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:10:35.760876 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:10:35.761384 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:10:35.761851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:10:35.762259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:10:35.762668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:10:35.771287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:35.771757 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:35.772179 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:35.772890 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:35.773336 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:35.773750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:35.789668 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for project a100e5012adf44d793aac8838ec5b120. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:10:35.794235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for user 0957d7b6060648bca681160dcbc731e8 and project a100e5012adf44d793aac8838ec5b120. Resources: {'cores', 'instances', 'ram'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:10:35.850013 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:10:35.852095 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1accb37-8162-4076-b2ed-9c065f26d189',volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:10:35.981626 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6ab608aa-c8eb-48dc-9a62-a815129b5ddf tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698676 Aug 07 11:10:35.982255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 605/1224] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:10:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 11:10:35.993223 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-386057a9-329b-4da4-9614-ee7c447346d3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:35.993834 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-386057a9-329b-4da4-9614-ee7c447346d3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:36.051224 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-386057a9-329b-4da4-9614-ee7c447346d3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:36.057994 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-386057a9-329b-4da4-9614-ee7c447346d3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1092 microversion: 2.1 time: 0.068612 Aug 07 11:10:36.070719 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 620/1225] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:35 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:10:37.081245 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:37.081874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:37.090333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:37.091031 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:37.091670 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:37.092476 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:37.093035 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:37.093558 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:37.184433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:37.193007 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-55fa774e-058e-4c17-93f2-7d8f49fc75ea tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1198 microversion: 2.1 time: 0.116601 Aug 07 11:10:37.193569 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 606/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:37 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:38.216961 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:38.217679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:38.225946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:38.226563 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:38.227010 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:38.227793 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:38.228434 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:38.228841 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:38.640046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:38.647470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f2a2b8f4-5489-4b41-bf8e-55a2d5bf8d16 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1276 microversion: 2.1 time: 0.437325 Aug 07 11:10:38.648034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 621/1227] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:38 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1276 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:38.989737 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a", "tag": "a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:10:39.000424 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:39.000895 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:39.001316 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:39.016752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] Creating event network-changed:a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94 for instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a on hv-cinder-85032 Aug 07 11:10:39.020604 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR oslo.messaging._drivers.impl_rabbit [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] [857e5b13-061c-4e8c-9c6b-1ea751b4bdcf] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 11:10:39.668190 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:39.668794 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:39.675163 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:39.675639 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:39.676069 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:39.676746 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:39.677195 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:39.677617 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:39.809992 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:39.817499 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3fdf0ad0-764c-4b5c-88f6-8dde444945fc tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.153088 Aug 07 11:10:39.818067 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 622/1228] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:39 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:10:40.027342 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] [857e5b13-061c-4e8c-9c6b-1ea751b4bdcf] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38448. Aug 07 11:10:40.030781 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-acc61224-bdca-4725-9103-225fe1c5f3b6 req-5612a35c-66c3-406f-826b-a49cf63fae04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.045018 Aug 07 11:10:40.031422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 607/1229] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:10:40.842614 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:40.843201 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:40.850914 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:40.851427 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:40.851861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:40.852552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:40.853006 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:40.853430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:40.982949 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:40.990542 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b9a4aceb-fcc4-444d-9de4-5d74100a6a94 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.156078 Aug 07 11:10:40.991158 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 623/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:40 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:42.013415 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:42.014102 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:42.020168 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:42.020643 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:42.021070 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:42.021747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:42.022197 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:42.022621 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:42.155010 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:42.162349 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0af9200c-63b3-42b1-91a9-b115f306010b tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.154297 Aug 07 11:10:42.162905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 608/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:42 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:43.182640 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:43.183354 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:43.189770 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:43.190244 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:43.190675 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:43.191379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:43.191831 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:43.192248 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:43.320645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:43.328717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-16cab288-b999-4aaf-ba9c-23535b4aa9f3 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.149935 Aug 07 11:10:43.329280 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 624/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:43 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:44.349442 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:44.350114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:44.357635 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:44.358114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:44.358546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:44.359260 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:44.359963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:44.360383 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:44.493474 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:44.501601 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fa2f6859-cccd-42aa-bd29-750c65b11819 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.156054 Aug 07 11:10:44.502156 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 609/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:44 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:45.522397 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:45.522916 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:45.530063 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:45.530541 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:45.531011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:45.531697 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:45.532147 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:45.532565 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:45.663738 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:45.671378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1aad29b6-f3be-4a29-8865-540a2b7d984e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.152896 Aug 07 11:10:45.671943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 625/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:45 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:46.692285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:46.692815 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:46.695239 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:10:46.695897 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=6 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:10:46.702177 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:46.702659 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:46.703122 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:46.703816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:46.704266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:46.704688 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:46.835855 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:46.843672 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c2c79de5-9085-4917-98fc-588d7c48aa04 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.155677 Aug 07 11:10:46.844229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 610/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:46 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:47.864930 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:47.865571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:47.867530 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:10:47.874199 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:47.874689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:47.875153 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:47.875861 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:47.876328 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:47.876756 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:48.005750 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:48.013393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a93881e6-9970-4bd1-9524-d21f0cf18a0c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.152377 Aug 07 11:10:48.013952 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 626/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:47 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:49.033617 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:49.034238 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:49.040607 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:49.041090 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:49.041530 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:49.042230 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:49.042739 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:49.043440 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:49.173464 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:49.180858 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ec1081a7-babd-44ce-919f-497d84ebcee1 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.151128 Aug 07 11:10:49.181457 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 611/1237] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:49 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:50.202429 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:50.203187 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:50.209539 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:50.210027 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:50.210463 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:50.211186 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:50.211645 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:50.212076 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:50.349896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-828f9449-f00a-436f-a8e7-3bfa173d2abb req-5aef4fd3-8ab1-4d19-bd1d-4e3a242065b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a", "name": "network-vif-plugged", "status": "completed", "tag": "a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:10:50.353850 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:50.360229 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-828f9449-f00a-436f-a8e7-3bfa173d2abb req-5aef4fd3-8ab1-4d19-bd1d-4e3a242065b1 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:50.360806 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-828f9449-f00a-436f-a8e7-3bfa173d2abb req-5aef4fd3-8ab1-4d19-bd1d-4e3a242065b1 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:50.361243 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-828f9449-f00a-436f-a8e7-3bfa173d2abb req-5aef4fd3-8ab1-4d19-bd1d-4e3a242065b1 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:50.362473 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-83adf338-9e15-4177-930c-af519d009975 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.164528 Aug 07 11:10:50.363059 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 627/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:50 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:50.378746 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-828f9449-f00a-436f-a8e7-3bfa173d2abb req-5aef4fd3-8ab1-4d19-bd1d-4e3a242065b1 service nova] Creating event network-vif-plugged:a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94 for instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a on hv-cinder-85032 Aug 07 11:10:50.383874 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-828f9449-f00a-436f-a8e7-3bfa173d2abb req-5aef4fd3-8ab1-4d19-bd1d-4e3a242065b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099170 Aug 07 11:10:50.384398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 612/1239] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:10:51.383300 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:51.383964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:51.391089 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:51.391562 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:51.391989 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:51.392670 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:51.393116 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:51.393533 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:51.528343 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:51.536228 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-86e8d315-4776-4714-a461-710d306a689c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1264 microversion: 2.1 time: 0.156724 Aug 07 11:10:51.536835 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 628/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:51 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:52.559640 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:52.560338 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:52.566422 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:52.566900 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:52.567363 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:52.568046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:52.568501 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:52.568924 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:52.699835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:52.707255 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ac11263f-f57c-4686-acaf-44244527b1b9 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1451 microversion: 2.1 time: 0.152804 Aug 07 11:10:52.707813 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 613/1241] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:52 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:52.727057 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:10:52.727668 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:10:52.734622 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:52.735382 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:52.735815 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:52.736501 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:52.736957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:52.737379 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:52.867219 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:10:52.875435 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d4e8b9e-f971-40a8-ae8b-7964948fad4c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1451 microversion: 2.1 time: 0.152325 Aug 07 11:10:52.875995 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 629/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:10:52 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:10:54.449038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2a009e7c-8877-4787-962c-0013fab2cae4 req-d2e44abc-8798-4567-a168-ce64300e7c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a", "tag": "a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:10:54.458770 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a009e7c-8877-4787-962c-0013fab2cae4 req-d2e44abc-8798-4567-a168-ce64300e7c14 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:10:54.459282 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a009e7c-8877-4787-962c-0013fab2cae4 req-d2e44abc-8798-4567-a168-ce64300e7c14 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:10:54.459710 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2a009e7c-8877-4787-962c-0013fab2cae4 req-d2e44abc-8798-4567-a168-ce64300e7c14 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:10:54.473588 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2a009e7c-8877-4787-962c-0013fab2cae4 req-d2e44abc-8798-4567-a168-ce64300e7c14 service nova] Creating event network-changed:a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94 for instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a on hv-cinder-85032 Aug 07 11:10:54.478439 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2a009e7c-8877-4787-962c-0013fab2cae4 req-d2e44abc-8798-4567-a168-ce64300e7c14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033658 Aug 07 11:10:54.479324 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 614/1243] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:11:13.450604 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:11:13.451075 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Sun Aug 7 11:11:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:12:08.231306 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:12:08.232011 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Sun Aug 7 11:12:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:12:42.266835 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:12:42.267427 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:12:51.994840 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1614634512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1484629655", "security_groups": [{"name": "tempest-secgroup-smoke-1686257402"}], "block_device_mapping_v2": [{"uuid": "373bc801-3ec3-47e5-bbbb-19100c705ec8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "92e2a885-c31d-4a1a-9780-2bc64b83e6ec"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:12:52.005457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [39d9af27-f70f-4f01-bb39-7f6d489f223c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 11:12:52.006001 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:12:52.006662 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:12:52.117420 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] validate_networks() for [('92e2a885-c31d-4a1a-9780-2bc64b83e6ec', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 11:12:52.767468 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 11:12:52.767892 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 11:12:52.768411 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 11:12:52.768821 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 11:12:52.769230 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 11:12:52.778615 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:52.779134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:52.779567 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:52.780292 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:52.780748 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:52.781170 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:52.798346 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for project a100e5012adf44d793aac8838ec5b120. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 11:12:52.802307 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Getting quotas for user 0957d7b6060648bca681160dcbc731e8 and project a100e5012adf44d793aac8838ec5b120. Resources: {'cores', 'instances', 'ram'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 11:12:52.857975 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 11:12:52.860407 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='373bc801-3ec3-47e5-bbbb-19100c705ec8',volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 11:12:52.990513 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-aae7decb-7f35-4e69-9482-91835a000c02 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999981 Aug 07 11:12:52.991184 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 630/1244] 10.222.0.25 () {60 vars in 1147 bytes} [Sun Aug 7 11:12:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 11:12:53.000946 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8fe2ec4-667a-4335-8893-a7e5b34ab43e] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 07 11:12:53.001535 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:12:53.002500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=64 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:12:53.007187 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-068a5066-e11b-4340-9c0a-d09ad3c18b89 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:12:53.008069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-068a5066-e11b-4340-9c0a-d09ad3c18b89 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:12:53.063534 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-068a5066-e11b-4340-9c0a-d09ad3c18b89 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:12:53.070321 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-068a5066-e11b-4340-9c0a-d09ad3c18b89 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1095 microversion: 2.1 time: 0.072000 Aug 07 11:12:53.070902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 615/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:12:52 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:12:54.091457 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:12:54.092073 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:12:54.106402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:54.107034 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:54.107487 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:54.108296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:54.108943 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:54.109552 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:54.129234 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] [39d9af27-f70f-4f01-bb39-7f6d489f223c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38596. Aug 07 11:12:54.186690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:12:54.194117 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-04b2b5a6-6c29-41b6-a1ae-048dd7b8c144 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1211 microversion: 2.1 time: 0.107477 Aug 07 11:12:54.194681 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 631/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:12:54 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:12:55.216477 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:12:55.217083 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:12:55.225773 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:55.226256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:55.226689 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:55.227404 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:55.227859 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:55.228285 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:55.234448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8fe2ec4-667a-4335-8893-a7e5b34ab43e] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38600. Aug 07 11:12:55.409012 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:12:55.417114 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7595ce77-390f-4362-b542-6d80be220601 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.205440 Aug 07 11:12:55.417881 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 616/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:12:55 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:12:55.486338 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-339b7a6b-1c0f-49b7-8cd7-936be651c2ca req-12ea6a29-c25a-45b4-a940-99ed9380db77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7815f9-6252-4bd4-8eb3-a3c45049332f", "tag": "a02b5e7c-3907-4ddc-a14a-5f99064b7908"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:12:55.499352 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-339b7a6b-1c0f-49b7-8cd7-936be651c2ca req-12ea6a29-c25a-45b4-a940-99ed9380db77 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:55.499936 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-339b7a6b-1c0f-49b7-8cd7-936be651c2ca req-12ea6a29-c25a-45b4-a940-99ed9380db77 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:55.500589 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-339b7a6b-1c0f-49b7-8cd7-936be651c2ca req-12ea6a29-c25a-45b4-a940-99ed9380db77 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:55.514276 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-339b7a6b-1c0f-49b7-8cd7-936be651c2ca req-12ea6a29-c25a-45b4-a940-99ed9380db77 service nova] Creating event network-changed:a02b5e7c-3907-4ddc-a14a-5f99064b7908 for instance cf7815f9-6252-4bd4-8eb3-a3c45049332f on hv-cinder-85032 Aug 07 11:12:55.519490 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-339b7a6b-1c0f-49b7-8cd7-936be651c2ca req-12ea6a29-c25a-45b4-a940-99ed9380db77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037724 Aug 07 11:12:55.520083 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 632/1248] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:12:56.437712 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:12:56.438333 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:12:56.444747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:56.445228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:56.445665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:56.446391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:56.446851 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:56.447369 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:56.578567 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:12:56.586209 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ee5ff7aa-4be8-4c73-92fe-fab91fa1de42 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.152361 Aug 07 11:12:56.589996 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 617/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:12:56 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:12:57.608356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:12:57.609044 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:12:57.615356 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:57.615833 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:57.616262 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:57.616940 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:57.617384 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:57.617799 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:57.754679 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:12:57.762837 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d7ab696-4e3c-435f-bd84-5ff7f26a97ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.159293 Aug 07 11:12:57.763432 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 633/1250] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:12:57 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:12:58.782162 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:12:58.782750 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:12:58.789069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:58.789544 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:58.789975 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:58.791430 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:58.791928 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:58.792348 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:58.929549 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:12:58.937150 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e1bf355a-b01d-44b4-bd49-0ef6e1184193 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.158839 Aug 07 11:12:58.937715 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 618/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:12:58 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:12:59.957795 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:12:59.958406 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:12:59.965581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:59.966073 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:59.966510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:12:59.967229 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:12:59.967690 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:12:59.968118 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:00.101064 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:00.109268 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2cb14d81-5bc7-40d0-bf08-c6170d871e88 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.155425 Aug 07 11:13:00.109828 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 634/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:12:59 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:01.129642 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:01.130251 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:01.136908 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:01.137387 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:01.137816 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:01.138500 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:01.138969 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:01.139391 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:01.276894 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:01.284328 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6bf232fe-816e-448a-8caa-671bf35a9961 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.158583 Aug 07 11:13:01.284902 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 619/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:01 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:02.305393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:02.305999 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:02.312918 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:02.313394 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:02.313822 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:02.314500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:02.314972 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:02.315387 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:02.449474 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:02.456832 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-307ff5ba-2108-4e5b-b64a-284bdaeff992 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.155288 Aug 07 11:13:02.457399 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 635/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:02 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:03.477153 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:03.477762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:03.480684 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell0:SELECT=2 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:13:03.486256 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:03.486738 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:03.487192 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:03.487885 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:03.488339 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:03.488772 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:03.620620 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:03.628018 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8d1c57ee-eeb7-4204-ae7c-f08f5ea433ef tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.154781 Aug 07 11:13:03.628581 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 620/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:03 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:04.649179 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:04.649838 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:04.652000 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=2 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:13:04.652807 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell0:SELECT=6 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:13:04.659476 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:04.659962 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:04.660401 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:04.661101 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:04.661559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:04.661985 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:04.792714 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:04.800198 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f462a8ba-78e3-45d8-a0d2-c656f6d1f24d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.154925 Aug 07 11:13:04.800767 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 636/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:04 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:05.820914 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:05.821516 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:05.828499 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:05.828972 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:05.829397 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:05.830075 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:05.830521 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:05.830963 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:05.966419 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:05.973847 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5ef299ec-453b-4fc4-9f81-294dc182b2f6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.156824 Aug 07 11:13:05.974416 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 621/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:05 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:06.993730 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:06.994451 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:07.000947 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:07.001433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:07.001948 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:07.002648 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:07.003134 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:07.003561 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:07.057576 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-ca4e7b34-fcd1-4b79-be89-cb15c15e815b req-1502c48d-0d60-4c0a-be08-7acd8a8c460b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7815f9-6252-4bd4-8eb3-a3c45049332f", "name": "network-vif-plugged", "status": "completed", "tag": "a02b5e7c-3907-4ddc-a14a-5f99064b7908"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:13:07.068266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ca4e7b34-fcd1-4b79-be89-cb15c15e815b req-1502c48d-0d60-4c0a-be08-7acd8a8c460b service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:07.068748 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ca4e7b34-fcd1-4b79-be89-cb15c15e815b req-1502c48d-0d60-4c0a-be08-7acd8a8c460b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:07.069228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ca4e7b34-fcd1-4b79-be89-cb15c15e815b req-1502c48d-0d60-4c0a-be08-7acd8a8c460b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:07.083464 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-ca4e7b34-fcd1-4b79-be89-cb15c15e815b req-1502c48d-0d60-4c0a-be08-7acd8a8c460b service nova] Creating event network-vif-plugged:a02b5e7c-3907-4ddc-a14a-5f99064b7908 for instance cf7815f9-6252-4bd4-8eb3-a3c45049332f on hv-cinder-85032 Aug 07 11:13:07.089302 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-ca4e7b34-fcd1-4b79-be89-cb15c15e815b req-1502c48d-0d60-4c0a-be08-7acd8a8c460b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036055 Aug 07 11:13:07.090468 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 622/1258] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:13:07.147521 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:07.156624 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8ba0dfde-c3a7-4c02-9147-073869e7d84d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.166301 Aug 07 11:13:07.157296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 637/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:06 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:08.177546 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:08.178247 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:08.185052 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:08.185533 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:08.185974 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:08.186665 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:08.187151 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:08.187578 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:08.318265 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:08.326653 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a3772cbe-07e8-42a3-850a-f6f1767d0566 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1267 microversion: 2.1 time: 0.153371 Aug 07 11:13:08.327267 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 623/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:08 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:09.346795 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:09.347456 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:09.354510 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:09.355019 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:09.355430 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:09.356111 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:09.356557 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:09.356977 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:09.490301 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:09.498303 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c430e66e-713b-45c2-b0e2-950ffe9c7491 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1454 microversion: 2.1 time: 0.155363 Aug 07 11:13:09.498863 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 638/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:09 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:09.517789 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:13:09.518398 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:13:09.524728 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:09.525199 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:09.526337 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:09.527046 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:09.527496 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:09.527913 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:09.658537 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:13:09.666099 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-331e3bda-819d-4fcd-99f6-1bf5d5a57c1f tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1454 microversion: 2.1 time: 0.152032 Aug 07 11:13:09.666849 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 624/1262] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:13:09 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:13:11.456066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-92acc337-630d-4e10-970e-77dea11e0723 req-dabd2f84-9094-4f33-8677-4afaa21a6f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7815f9-6252-4bd4-8eb3-a3c45049332f", "tag": "a02b5e7c-3907-4ddc-a14a-5f99064b7908"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:13:11.466381 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-92acc337-630d-4e10-970e-77dea11e0723 req-dabd2f84-9094-4f33-8677-4afaa21a6f37 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:13:11.466852 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-92acc337-630d-4e10-970e-77dea11e0723 req-dabd2f84-9094-4f33-8677-4afaa21a6f37 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:13:11.467299 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-92acc337-630d-4e10-970e-77dea11e0723 req-dabd2f84-9094-4f33-8677-4afaa21a6f37 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:13:11.478537 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-92acc337-630d-4e10-970e-77dea11e0723 req-dabd2f84-9094-4f33-8677-4afaa21a6f37 service nova] Creating event network-changed:a02b5e7c-3907-4ddc-a14a-5f99064b7908 for instance cf7815f9-6252-4bd4-8eb3-a3c45049332f on hv-cinder-85032 Aug 07 11:13:11.484631 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-92acc337-630d-4e10-970e-77dea11e0723 req-dabd2f84-9094-4f33-8677-4afaa21a6f37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032121 Aug 07 11:13:11.485611 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 639/1263] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:15:14.598682 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_api:SELECT=22 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:15:14.600069 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG dbcounter [-] [117616] Writing DB stats nova_cell1:SELECT=50 {{(pid=117616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:15:14.602188 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR oslo.messaging._drivers.impl_rabbit [-] [39d9af27-f70f-4f01-bb39-7f6d489f223c] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 07 11:15:14.602744 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:15:14.603942 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG dbcounter [-] [117615] Writing DB stats nova_cell1:SELECT=48 {{(pid=117615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:15:14.604520 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:14.605137 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:14.613162 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:14.613850 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:14.614480 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:14.615238 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:14.615698 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:14.616124 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:14.641691 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:15:14.701364 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-55cd7b82-82d3-410d-a5f4-81811c9b4521 req-e82bbb07-9a44-4bc3-a033-2e43b787811b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7815f9-6252-4bd4-8eb3-a3c45049332f", "tag": "a02b5e7c-3907-4ddc-a14a-5f99064b7908"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:15:14.711243 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-55cd7b82-82d3-410d-a5f4-81811c9b4521 req-e82bbb07-9a44-4bc3-a033-2e43b787811b service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:14.711964 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-55cd7b82-82d3-410d-a5f4-81811c9b4521 req-e82bbb07-9a44-4bc3-a033-2e43b787811b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:14.713066 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-55cd7b82-82d3-410d-a5f4-81811c9b4521 req-e82bbb07-9a44-4bc3-a033-2e43b787811b service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:14.725530 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-55cd7b82-82d3-410d-a5f4-81811c9b4521 req-e82bbb07-9a44-4bc3-a033-2e43b787811b service nova] Creating event network-changed:a02b5e7c-3907-4ddc-a14a-5f99064b7908 for instance cf7815f9-6252-4bd4-8eb3-a3c45049332f on hv-cinder-85032 Aug 07 11:15:14.726697 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-71335a83-5a1b-48cf-9221-23ed4d097d46 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 204 len: 0 microversion: 2.1 time: 0.129843 Aug 07 11:15:14.731906 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 625/1264] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:15:14 2022] DELETE /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:15:14.732939 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-55cd7b82-82d3-410d-a5f4-81811c9b4521 req-e82bbb07-9a44-4bc3-a033-2e43b787811b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133138 Aug 07 11:15:14.734212 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 640/1265] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:15:14.738024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:14.738730 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:14.744630 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:14.745110 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:14.745541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:14.746287 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:14.746744 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:14.747211 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:14.882917 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:15:14.890752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4b97cd8d-ed49-4dbb-8070-e1330b0a6d91 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1579 microversion: 2.1 time: 0.157561 Aug 07 11:15:14.891346 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 626/1266] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:14 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 11:15:15.912735 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:15.913344 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:15.921596 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:15.922074 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:15.922500 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:15.923209 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:15.923660 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:15.924173 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:15.943772 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] [39d9af27-f70f-4f01-bb39-7f6d489f223c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38684. Aug 07 11:15:16.114673 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:15:16.122409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-84a427ba-eafb-4991-a7b7-5b3782ad9072 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1579 microversion: 2.1 time: 0.213781 Aug 07 11:15:16.123120 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 641/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:15 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1579 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:15:17.143571 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:17.144182 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:17.150541 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:17.151108 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:17.151543 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:17.152235 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:17.153366 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:17.153802 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:17.170698 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-5e3f8605-399d-48fb-8b19-ab6d314ba7a9 req-4b8e0620-b7b7-4f6f-adb1-10b68e43fc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7815f9-6252-4bd4-8eb3-a3c45049332f", "name": "network-vif-deleted", "tag": "a02b5e7c-3907-4ddc-a14a-5f99064b7908"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:15:17.179993 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5e3f8605-399d-48fb-8b19-ab6d314ba7a9 req-4b8e0620-b7b7-4f6f-adb1-10b68e43fc8a service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:17.180470 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5e3f8605-399d-48fb-8b19-ab6d314ba7a9 req-4b8e0620-b7b7-4f6f-adb1-10b68e43fc8a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:17.180901 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5e3f8605-399d-48fb-8b19-ab6d314ba7a9 req-4b8e0620-b7b7-4f6f-adb1-10b68e43fc8a service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:17.193359 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-5e3f8605-399d-48fb-8b19-ab6d314ba7a9 req-4b8e0620-b7b7-4f6f-adb1-10b68e43fc8a service nova] Creating event network-vif-deleted:a02b5e7c-3907-4ddc-a14a-5f99064b7908 for instance cf7815f9-6252-4bd4-8eb3-a3c45049332f on hv-cinder-85032 Aug 07 11:15:17.201722 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-5e3f8605-399d-48fb-8b19-ab6d314ba7a9 req-4b8e0620-b7b7-4f6f-adb1-10b68e43fc8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035406 Aug 07 11:15:17.202597 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 642/1268] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:15:17.227335 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:15:17.236038 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9e0d346a-a6bd-4089-a33d-76f5628975a2 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 200 len: 1392 microversion: 2.1 time: 0.096096 Aug 07 11:15:17.236543 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 627/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:17 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 1392 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:15:18.257245 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:18.257950 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: cf7815f9-6252-4bd4-8eb3-a3c45049332f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:18.265288 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:18.265775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:18.266214 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:18.266911 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:18.267402 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:18.267831 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:18.281784 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] HTTP exception thrown: Instance cf7815f9-6252-4bd4-8eb3-a3c45049332f could not be found. Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Request method failure captured: Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f HTTP/1.1 Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75zw5ejH284FRJebb2H6x3H7gBHqf9tnek2QL2DB8ZdzCwVKHwW96Iqj8_kUT_ZUxkXxsyOp9A2nyLDw-L4YZh3hiQFkPjcoVHpp20LTMgFj12ZXcw73E11g2LPVY4aCNnO1VoOUTRBzHhFQVrF24BQZk0fAJmUzoqxrkGyhpeWBqkw Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:15:18.283433 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a100e5012adf44d793aac8838ec5b120", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 0957d7b6060648bca681160dcbc731e8 Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance cf7815f9-6252-4bd4-8eb3-a3c45049332f could not be found. Aug 07 11:15:18.285191 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': 'cf7815f9-6252-4bd4-8eb3-a3c45049332f'} Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7815f9-6252-4bd4-8eb3-a3c45049332f could not be found. Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:15:18.286197 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7815f9-6252-4bd4-8eb3-a3c45049332f could not be found. Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7815f9-6252-4bd4-8eb3-a3c45049332f could not be found. Aug 07 11:15:18.287920 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:18.289409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Returning 404 to user: Instance cf7815f9-6252-4bd4-8eb3-a3c45049332f could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:15:18.289409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-16df6c26-8e5a-4641-83fe-e480b1b72a06 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f" status: 404 len: 111 microversion: 2.1 time: 0.032268 Aug 07 11:15:18.289409 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 643/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:18 2022] GET /compute/v2.1/servers/cf7815f9-6252-4bd4-8eb3-a3c45049332f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:15:21.338572 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:21.339112 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:21.341608 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-336b9b1b-a09d-4505-8e93-575114a24903 req-ff840963-6f2e-403b-9133-ed551c804faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a", "tag": "a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:15:21.346752 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:21.347331 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:21.347846 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:21.348603 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:21.349266 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:21.349747 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:21.352378 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-336b9b1b-a09d-4505-8e93-575114a24903 req-ff840963-6f2e-403b-9133-ed551c804faa service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:21.352866 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-336b9b1b-a09d-4505-8e93-575114a24903 req-ff840963-6f2e-403b-9133-ed551c804faa service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:21.353296 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-336b9b1b-a09d-4505-8e93-575114a24903 req-ff840963-6f2e-403b-9133-ed551c804faa service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:21.365525 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-336b9b1b-a09d-4505-8e93-575114a24903 req-ff840963-6f2e-403b-9133-ed551c804faa service nova] Creating event network-changed:a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94 for instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a on hv-cinder-85032 Aug 07 11:15:21.370946 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-336b9b1b-a09d-4505-8e93-575114a24903 req-ff840963-6f2e-403b-9133-ed551c804faa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 Aug 07 11:15:21.372483 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 644/1271] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 11:15:21.378863 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 11:15:21.459573 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-edb44db4-65da-4ecd-8f3d-8b1d320e106c tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 204 len: 0 microversion: 2.1 time: 0.124447 Aug 07 11:15:21.460269 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 628/1272] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:15:21 2022] DELETE /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 11:15:21.472728 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:21.473937 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:21.482536 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:21.483393 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:21.484421 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:21.485139 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:21.486503 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:21.486980 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:21.622503 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:15:21.630263 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1b937e03-516a-480a-b20a-4ebd0c33e421 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1576 microversion: 2.1 time: 0.165016 Aug 07 11:15:21.630832 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 645/1273] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:21 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:15:22.651467 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:22.652228 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:22.658666 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:22.659188 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:22.659629 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:22.660322 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:22.660780 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:22.661204 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:22.801433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:15:22.809518 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dc896d9a-2049-477d-8816-2fca9993bb7d tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1576 microversion: 2.1 time: 0.161805 Aug 07 11:15:22.810303 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 629/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:22 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:15:23.733658 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-267cbe5b-968f-4b17-988f-46ebe63f0fd6 req-bbdf5d8c-0adb-4346-95d6-1f7df7bebc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a", "name": "network-vif-deleted", "tag": "a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 11:15:23.743666 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-267cbe5b-968f-4b17-988f-46ebe63f0fd6 req-bbdf5d8c-0adb-4346-95d6-1f7df7bebc07 service nova] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:23.744141 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-267cbe5b-968f-4b17-988f-46ebe63f0fd6 req-bbdf5d8c-0adb-4346-95d6-1f7df7bebc07 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:23.744566 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-267cbe5b-968f-4b17-988f-46ebe63f0fd6 req-bbdf5d8c-0adb-4346-95d6-1f7df7bebc07 service nova] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:23.756693 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-267cbe5b-968f-4b17-988f-46ebe63f0fd6 req-bbdf5d8c-0adb-4346-95d6-1f7df7bebc07 service nova] Creating event network-vif-deleted:a91990dc-8a8b-4fbe-8be4-7c0b5bdfda94 for instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a on hv-cinder-85032 Aug 07 11:15:23.761775 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-267cbe5b-968f-4b17-988f-46ebe63f0fd6 req-bbdf5d8c-0adb-4346-95d6-1f7df7bebc07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032644 Aug 07 11:15:23.762740 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 646/1275] 10.222.0.25 () {64 vars in 1317 bytes} [Sun Aug 7 11:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 11:15:23.830817 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:23.831506 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:23.837762 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:23.838252 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:23.838680 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:23.839390 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:23.839844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:23.840259 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:23.901016 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0957d7b6060648bca681160dcbc731e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a100e5012adf44d793aac8838ec5b120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 11:15:23.910065 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e5e08e67-62aa-4a14-9761-d8aceffb90e6 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 200 len: 1223 microversion: 2.1 time: 0.083122 Aug 07 11:15:23.910625 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 630/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:23 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 11:15:24.932571 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:24.933258 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:24.940163 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:24.940576 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:24.941007 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:24.941689 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:24.942140 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:24.942559 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:24.955464 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] HTTP exception thrown: Instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a could not be found. Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Request method failure captured: Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a HTTP/1.1 Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75zw5ejH284FRJebb2H6x3H7gBHqf9tnek2QL2DB8ZdzCwVKHwW96Iqj8_kUT_ZUxkXxsyOp9A2nyLDw-L4YZh3hiQFkPjcoVHpp20LTMgFj12ZXcw73E11g2LPVY4aCNnO1VoOUTRBzHhFQVrF24BQZk0fAJmUzoqxrkGyhpeWBqkw Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:15:24.957042 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a100e5012adf44d793aac8838ec5b120", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 0957d7b6060648bca681160dcbc731e8 Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a could not be found. Aug 07 11:15:24.958829 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a'} Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a could not be found. Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:15:24.959915 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a could not be found. Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a could not be found. Aug 07 11:15:24.961581 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:24.963046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Returning 404 to user: Instance 4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:15:24.963046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8cf1b7b4-2a5a-40b5-bc8d-ede65a237035 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a" status: 404 len: 111 microversion: 2.1 time: 0.030624 Aug 07 11:15:24.963046 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 647/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:24 2022] GET /compute/v2.1/servers/4d9ebf6d-66a1-43a9-8682-c3e1b1c14c8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:15:25.650123 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:25.650632 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:25.657341 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:25.657818 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:25.659050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:25.659050 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:25.659519 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:25.659912 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:25.673953 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] HTTP exception thrown: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Request method failure captured: Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 HTTP/1.1 Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept: application/json Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Connection: close Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Length: 0 Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Content-Type: application/json Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Host: 10.222.0.25 Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.11 Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABi75zw5ejH284FRJebb2H6x3H7gBHqf9tnek2QL2DB8ZdzCwVKHwW96Iqj8_kUT_ZUxkXxsyOp9A2nyLDw-L4YZh3hiQFkPjcoVHpp20LTMgFj12ZXcw73E11g2LPVY4aCNnO1VoOUTRBzHhFQVrF24BQZk0fAJmUzoqxrkGyhpeWBqkw Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Id: None Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Domain-Name: None Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Role: reader,member Aug 07 11:15:25.675785 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Roles: reader,member Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a100e5012adf44d793aac8838ec5b120", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Id: 0957d7b6060648bca681160dcbc731e8 Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: method: > Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: exception: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.677844 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: action_args: {'id': '38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2'} Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:15:25.679167 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.680905 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.682660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Returning 404 to user: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:15:25.682660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-15a10434-ef8d-4a24-b6f3-7b5680a5898e tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "DELETE /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 404 len: 111 microversion: 2.1 time: 0.030924 Aug 07 11:15:25.682660 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 631/1278] 10.222.0.25 () {58 vars in 1239 bytes} [Sun Aug 7 11:15:25 2022] DELETE /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:15:25.686558 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:25.687200 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] [instance: 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 11:15:25.692957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:25.693418 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:25.693879 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:25.694554 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Acquiring lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 11:15:25.695030 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 11:15:25.695444 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Lock "8cf8b7f3-2643-43e0-8bb5-27854ec1f83d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 11:15:25.711108 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] HTTP exception thrown: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Request method failure captured: Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 HTTP/1.1 Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept: application/json Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Connection: close Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Length: 0 Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Content-Type: application/json Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Host: 10.222.0.25 Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.11 Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABi75zw5ejH284FRJebb2H6x3H7gBHqf9tnek2QL2DB8ZdzCwVKHwW96Iqj8_kUT_ZUxkXxsyOp9A2nyLDw-L4YZh3hiQFkPjcoVHpp20LTMgFj12ZXcw73E11g2LPVY4aCNnO1VoOUTRBzHhFQVrF24BQZk0fAJmUzoqxrkGyhpeWBqkw Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Id: None Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Domain-Name: None Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Role: reader,member Aug 07 11:15:25.712602 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Roles: reader,member Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a100e5012adf44d793aac8838ec5b120", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a100e5012adf44d793aac8838ec5b120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Id: a100e5012adf44d793aac8838ec5b120 Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-1010492909 Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Id: 0957d7b6060648bca681160dcbc731e8 Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-1010492909-project Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: method: > Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: exception: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.714327 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: action_args: {'id': '38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2'} Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 11:15:25.715957 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. Aug 07 11:15:25.717717 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Aug 07 11:15:25.719167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Returning 404 to user: Instance 38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 11:15:25.719167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7837127f-7788-4dbf-befb-0c848595d814 tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2" status: 404 len: 111 microversion: 2.1 time: 0.031616 Aug 07 11:15:25.719167 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 648/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Sun Aug 7 11:15:25 2022] GET /compute/v2.1/servers/38aee3f9-ccae-4e5a-85f2-08ba30ce0cc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 11:15:27.003024 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-42bfc953-7e0c-4ad2-90be-c487e43f08be tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] Calling method '.version_select at 0x7fc5edbf9e50>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 11:15:27.024751 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-42bfc953-7e0c-4ad2-90be-c487e43f08be tempest-TestVolumeBootPattern-1010492909 tempest-TestVolumeBootPattern-1010492909-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1484629655" status: 202 len: 0 microversion: 2.1 time: 0.025974 Aug 07 11:15:27.029387 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 632/1280] 10.222.0.25 () {58 vars in 1263 bytes} [Sun Aug 7 11:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1484629655 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 11:15:28.239814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:15:28.240361 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Sun Aug 7 11:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:15:57.241896 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:15:57.242528 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:15:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:17:42.276448 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:17:42.277271 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:17:53.461884 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:17:53.462377 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Sun Aug 7 11:17:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:17:57.295433 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:17:57.295990 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:17:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:18:16.090479 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:18:16.091093 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Sun Aug 7 11:18:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:18:48.247814 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:18:48.248471 dv-cinder-850320-3-iscsi devstack@n-api.service[117615]: Sun Aug 7 11:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:19:17.250237 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:19:17.250891 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 11:21:02.284711 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 11:21:02.285409 dv-cinder-850320-3-iscsi devstack@n-api.service[117616]: Sun Aug 7 11:21:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!